2018-10-30 12:25:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 12:25:12 [DEBUG   ] Got command RPT from MCS: ref #321324
2018-10-30 12:25:12 [DEBUG   ] summary = ERROR
2018-10-30 12:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321324  13 58421 44712741 A  ERRORERROR'
2018-10-30 12:25:12 [DEBUG   ] Got command RPT from MCS: ref #321325
2018-10-30 12:25:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321325  77 58421 44712933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:25:13 [DEBUG   ] Got command RPT from MCS: ref #321326
2018-10-30 12:25:13 [DEBUG   ] summary = ERROR
2018-10-30 12:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321326  13 58421 44713137 A  ERRORERROR'
2018-10-30 12:25:13 [DEBUG   ] Got command RPT from MCS: ref #321328
2018-10-30 12:25:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321328  77 58421 44713341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:25:13 [DEBUG   ] Got command RPT from MCS: ref #321330
2018-10-30 12:25:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 12:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321330  12 58421 44713541 A  ERRORB'
2018-10-30 12:25:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:25:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:25:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:25:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:25:13 [DEBUG   ] Finished updating board flags in 1.278 seconds
2018-10-30 12:25:24 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-30 12:25:39 [DEBUG   ] Got command RPT from MCS: ref #321334
2018-10-30 12:25:39 [DEBUG   ] summary = ERROR
2018-10-30 12:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321334  13 58421 44739821 A  ERRORERROR'
2018-10-30 12:25:39 [DEBUG   ] Got command RPT from MCS: ref #321335
2018-10-30 12:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321335  77 58421 44739822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:25:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:26:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:26:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:26:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:26:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:26:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:26:13 [DEBUG   ] Finished updating board flags in 1.132 seconds
2018-10-30 12:26:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:26:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:27:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:27:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:27:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:27:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:27:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:27:13 [DEBUG   ] Finished updating board flags in 1.061 seconds
2018-10-30 12:27:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:27:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:28:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:28:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:28:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:28:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:28:13 [WARNING ] (13, 1, 'bot')
2018-10-30 12:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:28:13 [DEBUG   ] Finished updating board flags in 0.951 seconds
2018-10-30 12:28:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:28:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:29:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:29:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:29:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:29:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:29:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:29:14 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-30 12:29:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 12:29:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 12:30:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 12:30:12 [DEBUG   ] Got command RPT from MCS: ref #321355
2018-10-30 12:30:12 [DEBUG   ] summary = ERROR
2018-10-30 12:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321355  13 58421 45012821 A  ERRORERROR'
2018-10-30 12:30:13 [DEBUG   ] Got command RPT from MCS: ref #321356
2018-10-30 12:30:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321356  77 58421 45013025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:30:13 [DEBUG   ] Got command RPT from MCS: ref #321357
2018-10-30 12:30:13 [DEBUG   ] summary = ERROR
2018-10-30 12:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321357  13 58421 45013229 A  ERRORERROR'
2018-10-30 12:30:13 [DEBUG   ] Got command RPT from MCS: ref #321358
2018-10-30 12:30:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321358  77 58421 45013422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:30:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 12:30:13 [DEBUG   ] Got command RPT from MCS: ref #321359
2018-10-30 12:30:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 12:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321359  12 58421 45013630 A  ERRORB'
2018-10-30 12:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:30:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 12:30:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:30:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:30:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:30:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:30:14 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-10-30 12:30:24 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-30 12:30:39 [DEBUG   ] Got command RPT from MCS: ref #321364
2018-10-30 12:30:39 [DEBUG   ] summary = ERROR
2018-10-30 12:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321364  13 58421 45039821 A  ERRORERROR'
2018-10-30 12:30:39 [DEBUG   ] Got command RPT from MCS: ref #321365
2018-10-30 12:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321365  77 58421 45039822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:30:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:31:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 12:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 12:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 12:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 12:31:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:31:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:31:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:31:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:31:14 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-10-30 12:31:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:31:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:32:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:32:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:32:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:32:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:32:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:32:14 [DEBUG   ] Finished updating board flags in 1.029 seconds
2018-10-30 12:32:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:32:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 12:33:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 12:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:33:15 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-10-30 12:33:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:33:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 12:34:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 12:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:34:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:34:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:34:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:34:15 [WARNING ] (13, 1, 'bot')
2018-10-30 12:34:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:34:15 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-10-30 12:34:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:34:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:35:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:35:12 [DEBUG   ] Got command RPT from MCS: ref #321387
2018-10-30 12:35:12 [DEBUG   ] summary = ERROR
2018-10-30 12:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321387  13 58421 45312913 A  ERRORERROR'
2018-10-30 12:35:13 [DEBUG   ] Got command RPT from MCS: ref #321388
2018-10-30 12:35:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321388  77 58421 45313105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:35:13 [DEBUG   ] Got command RPT from MCS: ref #321389
2018-10-30 12:35:13 [DEBUG   ] summary = ERROR
2018-10-30 12:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321389  13 58421 45313309 A  ERRORERROR'
2018-10-30 12:35:13 [DEBUG   ] Got command RPT from MCS: ref #321390
2018-10-30 12:35:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321390  77 58421 45313513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:35:13 [DEBUG   ] Got command RPT from MCS: ref #321392
2018-10-30 12:35:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 12:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321392  12 58421 45313717 A  ERRORB'
2018-10-30 12:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:35:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:35:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:35:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:35:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:35:14 [DEBUG   ] Finished updating board flags in 1.263 seconds
2018-10-30 12:35:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:35:39 [DEBUG   ] Got command RPT from MCS: ref #321397
2018-10-30 12:35:39 [DEBUG   ] summary = ERROR
2018-10-30 12:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321397  13 58421 45339829 A  ERRORERROR'
2018-10-30 12:35:39 [DEBUG   ] Got command RPT from MCS: ref #321398
2018-10-30 12:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321398  77 58421 45339830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:35:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:36:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:36:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:36:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:36:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:36:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:36:14 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-10-30 12:36:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:36:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:37:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:37:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:37:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:37:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:37:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:37:14 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-10-30 12:37:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:37:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 12:38:00 [DEBUG   ] Got command RPT from MCS: ref #321418
2018-10-30 12:38:00 [DEBUG   ] summary = ERROR
2018-10-30 12:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321418  13 58421 45480485 A  ERRORERROR'
2018-10-30 12:38:00 [DEBUG   ] Got command RPT from MCS: ref #321419
2018-10-30 12:38:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321419  77 58421 45480486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:38:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:38:05 [DEBUG   ] Got command INI from MCS: ref #321420
2018-10-30 12:38:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-30 12:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   321420   8 58421 45485494 ABOOTING'
2018-10-30 12:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:38:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:38:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:38:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:38:14 [WARNING ] (13, 1, 'bot')
2018-10-30 12:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:38:14 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-10-30 12:38:25 [INFO    ] -------------------
2018-10-30 12:38:25 [INFO    ]  LWA board status
2018-10-30 12:38:25 [INFO    ] -------------------
2018-10-30 12:38:25 [INFO    ] DP 1: 2 lwa27
2018-10-30 12:38:25 [INFO    ] DP 1: 3 lwa24
2018-10-30 12:38:25 [INFO    ] DP 1: 4 lwa23
2018-10-30 12:38:25 [INFO    ] DP 1: 5 lwa18
2018-10-30 12:38:25 [INFO    ] DP 1: 6 lwa10
2018-10-30 12:38:25 [INFO    ] DP 1: 7 lwa32
2018-10-30 12:38:25 [INFO    ] DP 1: 8 lwa11
2018-10-30 12:38:25 [INFO    ] DP 1: 9 lwa30
2018-10-30 12:38:25 [INFO    ] DP 1: 10 lwa12
2018-10-30 12:38:25 [INFO    ] DP 1: 11 lwa8
2018-10-30 12:38:25 [INFO    ] DP 1: 12 lwa13
2018-10-30 12:38:25 [INFO    ] DP 1: 13 lwa26
2018-10-30 12:38:25 [INFO    ] DP 1: 14 lwa14
2018-10-30 12:38:25 [INFO    ] DP 1: 16 lwa22
2018-10-30 12:38:25 [INFO    ] DP 1: 17 lwa20
2018-10-30 12:38:25 [INFO    ] DP 1: 18 lwa1
2018-10-30 12:38:25 [INFO    ] DP 1: 19 lwa5
2018-10-30 12:38:25 [INFO    ] DP 1: 20 lwa25
2018-10-30 12:38:25 [INFO    ] DP 1: 21 lwa35
2018-10-30 12:38:25 [INFO    ] DP 1: 22 lwa19
2018-10-30 12:38:25 [INFO    ] DP 1: 23 lwa21
2018-10-30 12:38:25 [INFO    ] DP 1: 24 lwa6
2018-10-30 12:38:25 [INFO    ] DP 1: 25 lwa7
2018-10-30 12:38:25 [INFO    ] DP 1: 26 lwa33
2018-10-30 12:38:25 [INFO    ] DP 1: 27 lwa15
2018-10-30 12:38:25 [INFO    ] DP 1: 28 lwa28
2018-10-30 12:38:25 [INFO    ] DP 2: 1 lwa16
2018-10-30 12:38:25 [INFO    ] DP 2: 15 lwa34
2018-10-30 12:38:25 [INFO    ] Total of 28 boards
2018-10-30 12:38:25 [INFO    ] Total of 260 stands
2018-10-30 12:38:25 [INFO    ] -------------------
2018-10-30 12:38:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2129
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2130
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2131
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2132
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2133
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2134
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2135
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2136
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2137
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2138
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2139
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2140
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2141
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2142
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2143
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2144
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2145
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2146
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2147
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2148
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2149
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2150
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2151
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2152
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2153
2018-10-30 12:38:32 [DEBUG   ] 2018-10-30 12:38:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2154
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2129 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2130 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2131 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2132 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2133 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2134 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2135 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2136 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2137 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2138 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2139 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2140 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2141 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2142 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2143 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2144 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2145 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2146 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2147 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2148 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2149 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2150 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2151 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2152 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2153 exited with status 0
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2154 exited with status 0
2018-10-30 12:38:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] spawn_process: at 2018-10-30 12:38:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2181
2018-10-30 12:38:44 [DEBUG   ] 2018-10-30 12:38:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2182
2018-10-30 12:38:50 [DEBUG   ] 2018-10-30 12:38:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2181 exited with status 0
2018-10-30 12:38:50 [DEBUG   ] 2018-10-30 12:38:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2182 exited with status 0
2018-10-30 12:38:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-30 12:38:50 [DEBUG   ] spawn_process: at 2018-10-30 12:38:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-30 12:38:50 [DEBUG   ] spawn_process: at 2018-10-30 12:38:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-30 12:38:50 [INFO    ] Setting Beam 1 xbars
2018-10-30 12:38:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-30 12:38:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-30 12:38:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-30 12:38:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-30 12:38:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-30 12:38:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-30 12:38:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-30 12:38:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-30 12:38:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-30 12:38:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-30 12:38:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-30 12:38:55 [INFO    ] Setting Beam 2 xbars
2018-10-30 12:38:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-30 12:38:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-30 12:38:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-30 12:38:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-30 12:38:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-30 12:38:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-30 12:39:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-30 12:39:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-30 12:39:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-30 12:39:01 [INFO    ] Setting Beam 3 xbars
2018-10-30 12:39:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-30 12:39:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-30 12:39:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-30 12:39:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-30 12:39:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-30 12:39:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-30 12:39:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-30 12:39:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-30 12:39:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-30 12:39:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-30 12:39:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-30 12:39:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-30 12:39:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-30 12:39:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-30 12:39:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-30 12:39:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-30 12:39:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-30 12:39:06 [INFO    ] Setting Beam 4 xbars
2018-10-30 12:39:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-30 12:39:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 12:39:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-30 12:39:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-30 12:39:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-30 12:39:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-30 12:39:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-30 12:39:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-30 12:39:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-30 12:39:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-30 12:39:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-30 12:39:12 [INFO    ] All xbars set
2018-10-30 12:39:12 [INFO    ] Setting adder chain routing for all beams
2018-10-30 12:39:17 [INFO    ] Setting beam ids
2018-10-30 12:39:27 [INFO    ] Starting beam delay calibration
2018-10-30 12:39:39 [INFO    ] Beam 1 latency is 5748
2018-10-30 12:39:39 [INFO    ] Beam 2 latency is 5741
2018-10-30 12:39:39 [INFO    ] Beam 3 latency is 5737
2018-10-30 12:39:39 [INFO    ] Beam 4 latency is 6671
2018-10-30 12:39:39 [INFO    ] Stop calibration
2018-10-30 12:39:47 [ERROR   ] Beam delay calibration failed
2018-10-30 12:39:47 [CRITICAL] Calibration failed
2018-10-30 12:39:47 [DEBUG   ] spawn_process: at 2018-10-30 12:39:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-30 12:39:47 [DEBUG   ] spawn_process: at 2018-10-30 12:39:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-30 12:39:47 [DEBUG   ] spawn_process: at 2018-10-30 12:39:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-30 12:39:47 [DEBUG   ] spawn_process: at 2018-10-30 12:39:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-30 12:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-30 12:39:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 12:39:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 521 ms (1540903187.524 s) with PID 3861 and time 1540903188
2018-10-30 12:39:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 12:39:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 296 ms (1540903188.299 s) with PID 3883 and time 1540903189
2018-10-30 12:39:49 [DEBUG   ] Finished updating ant stats in 0.949 seconds
2018-10-30 12:39:49 [INFO    ] Started antennas statistics background thread
2018-10-30 12:39:49 [INFO    ] Started board flags background thread
2018-10-30 12:39:49 [INFO    ] Started BAM background thread
2018-10-30 12:39:49 [INFO    ] Finished the INI process (ref. #321420) in 103.928 s
2018-10-30 12:39:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:39:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:39:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:39:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:39:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:39:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-30 12:39:50 [DEBUG   ] Finished updating board flags in 1.136 seconds
2018-10-30 12:40:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:40:12 [DEBUG   ] Got command RPT from MCS: ref #321425
2018-10-30 12:40:12 [DEBUG   ] summary = ERROR
2018-10-30 12:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321425  13 58421 45612993 A  ERRORERROR'
2018-10-30 12:40:13 [DEBUG   ] Got command RPT from MCS: ref #321426
2018-10-30 12:40:13 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321426  98 58421 45613197 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:40:13 [DEBUG   ] Got command RPT from MCS: ref #321427
2018-10-30 12:40:13 [DEBUG   ] summary = ERROR
2018-10-30 12:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321427  13 58421 45613401 A  ERRORERROR'
2018-10-30 12:40:13 [DEBUG   ] Got command RPT from MCS: ref #321428
2018-10-30 12:40:13 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321428  98 58421 45613593 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:40:13 [DEBUG   ] Got command RPT from MCS: ref #321429
2018-10-30 12:40:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 12:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321429  12 58421 45613797 A  ERRORB'
2018-10-30 12:40:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:40:39 [DEBUG   ] Got command RPT from MCS: ref #321430
2018-10-30 12:40:39 [DEBUG   ] summary = ERROR
2018-10-30 12:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321430  13 58421 45639829 A  ERRORERROR'
2018-10-30 12:40:39 [DEBUG   ] Got command RPT from MCS: ref #321431
2018-10-30 12:40:39 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321431  98 58421 45639830 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:40:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:40:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:40:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:40:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:40:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:40:50 [WARNING ] (13, 1, 'bot')
2018-10-30 12:40:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-30 12:40:50 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-10-30 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #321447
2018-10-30 12:41:05 [DEBUG   ] summary = ERROR
2018-10-30 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321447  13 58421 45665497 A  ERRORERROR'
2018-10-30 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #321448
2018-10-30 12:41:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321448  98 58421 45665498 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:41:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:41:10 [DEBUG   ] Got command INI from MCS: ref #321449
2018-10-30 12:41:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-30 12:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   321449   8 58421 45670506 ABOOTING'
2018-10-30 12:41:31 [INFO    ] -------------------
2018-10-30 12:41:31 [INFO    ]  LWA board status
2018-10-30 12:41:31 [INFO    ] -------------------
2018-10-30 12:41:31 [INFO    ] DP 1: 2 lwa27
2018-10-30 12:41:31 [INFO    ] DP 1: 3 lwa24
2018-10-30 12:41:31 [INFO    ] DP 1: 4 lwa23
2018-10-30 12:41:31 [INFO    ] DP 1: 5 lwa18
2018-10-30 12:41:31 [INFO    ] DP 1: 6 lwa10
2018-10-30 12:41:31 [INFO    ] DP 1: 7 lwa32
2018-10-30 12:41:31 [INFO    ] DP 1: 8 lwa11
2018-10-30 12:41:31 [INFO    ] DP 1: 9 lwa30
2018-10-30 12:41:31 [INFO    ] DP 1: 10 lwa12
2018-10-30 12:41:31 [INFO    ] DP 1: 11 lwa8
2018-10-30 12:41:31 [INFO    ] DP 1: 12 lwa13
2018-10-30 12:41:31 [INFO    ] DP 1: 13 lwa26
2018-10-30 12:41:31 [INFO    ] DP 1: 14 lwa14
2018-10-30 12:41:31 [INFO    ] DP 1: 16 lwa22
2018-10-30 12:41:31 [INFO    ] DP 1: 17 lwa20
2018-10-30 12:41:31 [INFO    ] DP 1: 18 lwa1
2018-10-30 12:41:31 [INFO    ] DP 1: 19 lwa5
2018-10-30 12:41:31 [INFO    ] DP 1: 20 lwa25
2018-10-30 12:41:31 [INFO    ] DP 1: 21 lwa35
2018-10-30 12:41:31 [INFO    ] DP 1: 22 lwa19
2018-10-30 12:41:31 [INFO    ] DP 1: 23 lwa21
2018-10-30 12:41:31 [INFO    ] DP 1: 24 lwa6
2018-10-30 12:41:31 [INFO    ] DP 1: 25 lwa7
2018-10-30 12:41:31 [INFO    ] DP 1: 26 lwa33
2018-10-30 12:41:31 [INFO    ] DP 1: 27 lwa15
2018-10-30 12:41:31 [INFO    ] DP 1: 28 lwa28
2018-10-30 12:41:31 [INFO    ] DP 2: 1 lwa16
2018-10-30 12:41:31 [INFO    ] DP 2: 15 lwa34
2018-10-30 12:41:31 [INFO    ] Total of 28 boards
2018-10-30 12:41:31 [INFO    ] Total of 260 stands
2018-10-30 12:41:31 [INFO    ] -------------------
2018-10-30 12:41:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4448
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4449
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4450
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4451
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4452
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4453
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4454
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4455
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4456
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4457
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4458
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4459
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4460
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4461
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4462
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4463
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4464
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4465
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4466
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4467
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4468
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4469
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4470
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4471
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4472
2018-10-30 12:41:38 [DEBUG   ] 2018-10-30 12:41:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4473
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4448 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4449 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4450 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4451 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4452 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4453 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4454 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4455 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4456 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4457 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4458 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4459 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4460 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4461 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4462 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4463 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4464 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4465 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4466 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4467 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4468 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4469 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4470 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4471 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4472 exited with status 0
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4473 exited with status 0
2018-10-30 12:41:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] spawn_process: at 2018-10-30 12:41:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4500
2018-10-30 12:41:50 [DEBUG   ] 2018-10-30 12:41:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4501
2018-10-30 12:41:56 [DEBUG   ] 2018-10-30 12:41:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4500 exited with status 0
2018-10-30 12:41:56 [DEBUG   ] 2018-10-30 12:41:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4501 exited with status 0
2018-10-30 12:41:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-30 12:41:56 [DEBUG   ] spawn_process: at 2018-10-30 12:41:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-30 12:41:56 [DEBUG   ] spawn_process: at 2018-10-30 12:41:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-30 12:41:56 [INFO    ] Setting Beam 1 xbars
2018-10-30 12:41:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-30 12:41:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-30 12:41:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-30 12:41:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-30 12:41:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-30 12:41:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-30 12:41:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-30 12:41:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-30 12:41:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-30 12:42:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-30 12:42:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-30 12:42:01 [INFO    ] Setting Beam 2 xbars
2018-10-30 12:42:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-30 12:42:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-30 12:42:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-30 12:42:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-30 12:42:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-30 12:42:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-30 12:42:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-30 12:42:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-30 12:42:07 [INFO    ] Setting Beam 3 xbars
2018-10-30 12:42:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-30 12:42:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-30 12:42:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-30 12:42:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-30 12:42:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-30 12:42:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-30 12:42:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-30 12:42:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-30 12:42:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-30 12:42:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-30 12:42:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-30 12:42:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-30 12:42:12 [INFO    ] Setting Beam 4 xbars
2018-10-30 12:42:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-30 12:42:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 12:42:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-30 12:42:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-30 12:42:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-30 12:42:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-30 12:42:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-30 12:42:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-30 12:42:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-30 12:42:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-30 12:42:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-30 12:42:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-30 12:42:18 [INFO    ] All xbars set
2018-10-30 12:42:18 [INFO    ] Setting adder chain routing for all beams
2018-10-30 12:42:23 [INFO    ] Setting beam ids
2018-10-30 12:42:33 [INFO    ] Starting beam delay calibration
2018-10-30 12:42:45 [INFO    ] Beam 1 latency is 6700
2018-10-30 12:42:45 [INFO    ] Beam 2 latency is 5727
2018-10-30 12:42:45 [INFO    ] Beam 3 latency is 5734
2018-10-30 12:42:45 [INFO    ] Beam 4 latency is 6693
2018-10-30 12:42:45 [INFO    ] Stop calibration
2018-10-30 12:42:53 [ERROR   ] Beam delay calibration failed
2018-10-30 12:42:53 [CRITICAL] Calibration failed
2018-10-30 12:42:53 [DEBUG   ] spawn_process: at 2018-10-30 12:42:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-30 12:42:53 [DEBUG   ] spawn_process: at 2018-10-30 12:42:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-30 12:42:53 [DEBUG   ] spawn_process: at 2018-10-30 12:42:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-30 12:42:53 [DEBUG   ] spawn_process: at 2018-10-30 12:42:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-30 12:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-30 12:42:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 12:42:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 556 ms (1540903373.558 s) with PID 6077 and time 1540903374
2018-10-30 12:42:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 12:42:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 292 ms (1540903374.295 s) with PID 6098 and time 1540903375
2018-10-30 12:42:55 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2018-10-30 12:42:55 [INFO    ] Started antennas statistics background thread
2018-10-30 12:42:55 [INFO    ] Started board flags background thread
2018-10-30 12:42:55 [INFO    ] Started BAM background thread
2018-10-30 12:42:55 [INFO    ] Finished the INI process (ref. #321449) in 104.912 s
2018-10-30 12:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:42:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:42:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:42:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:42:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:42:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-30 12:42:56 [DEBUG   ] Finished updating board flags in 1.136 seconds
2018-10-30 12:43:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:43:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:43:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:43:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 12:43:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:43:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:43:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:43:56 [WARNING ] (13, 1, 'bot')
2018-10-30 12:43:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-30 12:43:56 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-10-30 12:44:10 [DEBUG   ] Got command RPT from MCS: ref #321454
2018-10-30 12:44:10 [DEBUG   ] summary = ERROR
2018-10-30 12:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321454  13 58421 45850501 A  ERRORERROR'
2018-10-30 12:44:10 [DEBUG   ] Got command RPT from MCS: ref #321455
2018-10-30 12:44:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321455  98 58421 45850502 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:44:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:44:15 [DEBUG   ] Got command INI from MCS: ref #321456
2018-10-30 12:44:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-30 12:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   321456   8 58421 45855510 ABOOTING'
2018-10-30 12:44:36 [INFO    ] -------------------
2018-10-30 12:44:36 [INFO    ]  LWA board status
2018-10-30 12:44:36 [INFO    ] -------------------
2018-10-30 12:44:36 [INFO    ] DP 1: 2 lwa27
2018-10-30 12:44:36 [INFO    ] DP 1: 3 lwa24
2018-10-30 12:44:36 [INFO    ] DP 1: 4 lwa23
2018-10-30 12:44:36 [INFO    ] DP 1: 5 lwa18
2018-10-30 12:44:36 [INFO    ] DP 1: 6 lwa10
2018-10-30 12:44:36 [INFO    ] DP 1: 7 lwa32
2018-10-30 12:44:36 [INFO    ] DP 1: 8 lwa11
2018-10-30 12:44:36 [INFO    ] DP 1: 9 lwa30
2018-10-30 12:44:36 [INFO    ] DP 1: 10 lwa12
2018-10-30 12:44:36 [INFO    ] DP 1: 11 lwa8
2018-10-30 12:44:36 [INFO    ] DP 1: 12 lwa13
2018-10-30 12:44:36 [INFO    ] DP 1: 13 lwa26
2018-10-30 12:44:36 [INFO    ] DP 1: 14 lwa14
2018-10-30 12:44:36 [INFO    ] DP 1: 16 lwa22
2018-10-30 12:44:36 [INFO    ] DP 1: 17 lwa20
2018-10-30 12:44:36 [INFO    ] DP 1: 18 lwa1
2018-10-30 12:44:36 [INFO    ] DP 1: 19 lwa5
2018-10-30 12:44:36 [INFO    ] DP 1: 20 lwa25
2018-10-30 12:44:36 [INFO    ] DP 1: 21 lwa35
2018-10-30 12:44:36 [INFO    ] DP 1: 22 lwa19
2018-10-30 12:44:36 [INFO    ] DP 1: 23 lwa21
2018-10-30 12:44:36 [INFO    ] DP 1: 24 lwa6
2018-10-30 12:44:36 [INFO    ] DP 1: 25 lwa7
2018-10-30 12:44:36 [INFO    ] DP 1: 26 lwa33
2018-10-30 12:44:36 [INFO    ] DP 1: 27 lwa15
2018-10-30 12:44:36 [INFO    ] DP 1: 28 lwa28
2018-10-30 12:44:36 [INFO    ] DP 2: 1 lwa16
2018-10-30 12:44:36 [INFO    ] DP 2: 15 lwa34
2018-10-30 12:44:36 [INFO    ] Total of 28 boards
2018-10-30 12:44:36 [INFO    ] Total of 260 stands
2018-10-30 12:44:36 [INFO    ] -------------------
2018-10-30 12:44:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6645
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6646
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6647
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6648
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6649
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6650
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6651
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6652
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6653
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6654
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6655
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6656
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6657
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6658
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6659
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6660
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6661
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6662
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6663
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6664
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6665
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6666
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6667
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6668
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6669
2018-10-30 12:44:43 [DEBUG   ] 2018-10-30 12:44:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6670
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6645 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6646 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6647 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6648 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6649 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6650 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6651 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6652 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6653 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6654 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6655 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6656 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6657 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6658 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6659 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6660 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6661 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6662 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6663 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6664 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6665 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6666 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6667 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6668 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6669 exited with status 0
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6670 exited with status 0
2018-10-30 12:44:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] spawn_process: at 2018-10-30 12:44:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6697
2018-10-30 12:44:55 [DEBUG   ] 2018-10-30 12:44:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6698
2018-10-30 12:45:01 [DEBUG   ] 2018-10-30 12:45:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6697 exited with status 0
2018-10-30 12:45:01 [DEBUG   ] 2018-10-30 12:45:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6698 exited with status 0
2018-10-30 12:45:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-30 12:45:01 [DEBUG   ] spawn_process: at 2018-10-30 12:45:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-30 12:45:01 [DEBUG   ] spawn_process: at 2018-10-30 12:45:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-30 12:45:01 [INFO    ] Setting Beam 1 xbars
2018-10-30 12:45:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-30 12:45:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-30 12:45:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-30 12:45:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-30 12:45:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-30 12:45:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-30 12:45:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-30 12:45:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-30 12:45:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-30 12:45:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-30 12:45:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-30 12:45:06 [INFO    ] Setting Beam 2 xbars
2018-10-30 12:45:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-30 12:45:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-30 12:45:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-30 12:45:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-30 12:45:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-30 12:45:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-30 12:45:12 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-30 12:45:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-30 12:45:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-30 12:45:12 [INFO    ] Setting Beam 3 xbars
2018-10-30 12:45:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-30 12:45:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-30 12:45:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-30 12:45:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-30 12:45:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-30 12:45:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-30 12:45:13 [DEBUG   ] Got command RPT from MCS: ref #321459
2018-10-30 12:45:13 [DEBUG   ] summary = BOOTING
2018-10-30 12:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321459  15 58421 45913086 ABOOTINGBOOTING'
2018-10-30 12:45:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-30 12:45:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-30 12:45:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-30 12:45:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-30 12:45:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-30 12:45:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-30 12:45:17 [INFO    ] Setting Beam 4 xbars
2018-10-30 12:45:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-30 12:45:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-30 12:45:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-30 12:45:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-30 12:45:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-30 12:45:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-30 12:45:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-30 12:45:23 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-30 12:45:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-30 12:45:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-30 12:45:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-30 12:45:23 [INFO    ] All xbars set
2018-10-30 12:45:23 [INFO    ] Setting adder chain routing for all beams
2018-10-30 12:45:28 [INFO    ] Setting beam ids
2018-10-30 12:45:38 [INFO    ] Starting beam delay calibration
2018-10-30 12:45:39 [DEBUG   ] Got command RPT from MCS: ref #321469
2018-10-30 12:45:39 [DEBUG   ] summary = BOOTING
2018-10-30 12:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321469  15 58421 45939826 ABOOTINGBOOTING'
2018-10-30 12:45:39 [DEBUG   ] Got command RPT from MCS: ref #321470
2018-10-30 12:45:39 [DEBUG   ] info = Starting calibration
2018-10-30 12:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321470  28 58421 45939826 ABOOTINGStarting calibration'
2018-10-30 12:45:50 [INFO    ] Beam 1 latency is 5731
2018-10-30 12:45:50 [INFO    ] Beam 2 latency is 5742
2018-10-30 12:45:50 [INFO    ] Beam 3 latency is 5733
2018-10-30 12:45:50 [INFO    ] Beam 4 latency is 5717
2018-10-30 12:45:50 [INFO    ] Stop calibration
2018-10-30 12:45:58 [INFO    ] Beam delay calibration successful
2018-10-30 12:45:58 [INFO    ] Calibration passed
2018-10-30 12:45:58 [DEBUG   ] spawn_process: at 2018-10-30 12:45:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-30 12:45:58 [DEBUG   ] spawn_process: at 2018-10-30 12:45:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-30 12:45:58 [DEBUG   ] spawn_process: at 2018-10-30 12:45:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-30 12:45:58 [DEBUG   ] spawn_process: at 2018-10-30 12:45:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-30 12:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-30 12:45:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 12:45:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 530 ms (1540903558.533 s) with PID 8268 and time 1540903559
2018-10-30 12:45:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 12:45:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 267 ms (1540903559.269 s) with PID 8289 and time 1540903560
2018-10-30 12:46:00 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2018-10-30 12:46:00 [INFO    ] Started antennas statistics background thread
2018-10-30 12:46:00 [INFO    ] Started board flags background thread
2018-10-30 12:46:00 [INFO    ] Started BAM background thread
2018-10-30 12:46:00 [INFO    ] Finished the INI process (ref. #321456) in 104.884 s
2018-10-30 12:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:46:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:46:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:46:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:46:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:46:01 [DEBUG   ] Finished updating board flags in 1.161 seconds
2018-10-30 12:46:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:46:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:47:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:47:01 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-30 12:47:15 [DEBUG   ] Got command RPT from MCS: ref #321486
2018-10-30 12:47:15 [DEBUG   ] summary = ERROR
2018-10-30 12:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321486  13 58421 46035509 A  ERRORERROR'
2018-10-30 12:47:15 [DEBUG   ] Got command RPT from MCS: ref #321487
2018-10-30 12:47:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321487  77 58421 46035510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:47:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:47:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:48:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 12:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:48:01 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-10-30 12:48:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:48:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:49:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 12:49:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:49:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:49:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:49:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:49:02 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-30 12:49:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:49:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:50:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:50:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:50:01 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-30 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #321492
2018-10-30 12:50:13 [DEBUG   ] summary = ERROR
2018-10-30 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321492  13 58421 46213169 A  ERRORERROR'
2018-10-30 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #321493
2018-10-30 12:50:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321493  77 58421 46213373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #321494
2018-10-30 12:50:13 [DEBUG   ] summary = ERROR
2018-10-30 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321494  13 58421 46213565 A  ERRORERROR'
2018-10-30 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #321495
2018-10-30 12:50:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321495  77 58421 46213769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #321496
2018-10-30 12:50:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321496  12 58421 46213973 A  ERRORB'
2018-10-30 12:50:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:50:39 [DEBUG   ] Got command RPT from MCS: ref #321497
2018-10-30 12:50:39 [DEBUG   ] summary = ERROR
2018-10-30 12:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321497  13 58421 46239829 A  ERRORERROR'
2018-10-30 12:50:39 [DEBUG   ] Got command RPT from MCS: ref #321498
2018-10-30 12:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321498  77 58421 46239830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:50:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:51:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:51:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:51:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:51:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:51:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:51:02 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-10-30 12:51:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:51:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:52:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 12:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 12:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:52:01 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-30 12:52:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:52:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:53:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 12:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 12:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:53:01 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-10-30 12:53:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:53:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:54:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:54:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:54:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:54:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:54:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:54:02 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-30 12:54:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:54:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:55:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:55:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:55:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:55:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:55:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:55:02 [DEBUG   ] Finished updating board flags in 1.335 seconds
2018-10-30 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #321524
2018-10-30 12:55:13 [DEBUG   ] summary = ERROR
2018-10-30 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321524  13 58421 46513249 A  ERRORERROR'
2018-10-30 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #321525
2018-10-30 12:55:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321525  77 58421 46513453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #321526
2018-10-30 12:55:13 [DEBUG   ] summary = ERROR
2018-10-30 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321526  13 58421 46513657 A  ERRORERROR'
2018-10-30 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #321528
2018-10-30 12:55:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321528  77 58421 46513861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:55:14 [DEBUG   ] Got command RPT from MCS: ref #321529
2018-10-30 12:55:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 12:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321529  12 58421 46514053 A  ERRORB'
2018-10-30 12:55:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:55:39 [DEBUG   ] Got command RPT from MCS: ref #321534
2018-10-30 12:55:39 [DEBUG   ] summary = ERROR
2018-10-30 12:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321534  13 58421 46539837 A  ERRORERROR'
2018-10-30 12:55:39 [DEBUG   ] Got command RPT from MCS: ref #321535
2018-10-30 12:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 12:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321535  77 58421 46539838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 12:55:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 12:56:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:56:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 12:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:56:02 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-10-30 12:56:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:56:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:57:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 12:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:57:02 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-10-30 12:57:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 12:57:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 12:58:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 12:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:58:02 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-30 12:58:09 [DEBUG   ] Got command DRX from MCS: ref #321560
2018-10-30 12:58:09 [INFO    ] sending drx command to lwa34
2018-10-30 12:58:09 [DEBUG   ] run_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2018-10-30 12:58:09 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   321560   8 58421 46689013 A  ERROR'
2018-10-30 12:58:09 [DEBUG   ] Got command DRX from MCS: ref #321559
2018-10-30 12:58:09 [INFO    ] sending drx command to lwa16
2018-10-30 12:58:09 [DEBUG   ] run_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2018-10-30 12:58:09 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   321559   8 58421 46689017 A  ERROR'
2018-10-30 12:58:09 [DEBUG   ] Got command DRX from MCS: ref #321561
2018-10-30 12:58:09 [INFO    ] sending drx command to lwa16
2018-10-30 12:58:09 [DEBUG   ] run_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2018-10-30 12:58:09 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   321561   8 58421 46689021 A  ERROR'
2018-10-30 12:58:09 [DEBUG   ] Got command DRX from MCS: ref #321562
2018-10-30 12:58:09 [INFO    ] sending drx command to lwa34
2018-10-30 12:58:09 [DEBUG   ] run_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2018-10-30 12:58:09 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   321562   8 58421 46689025 A  ERROR'
2018-10-30 12:58:09 [DEBUG   ] Got command BAM from MCS: ref #321563
2018-10-30 12:58:09 [INFO    ] Finished processing BAM request
2018-10-30 12:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321563   8 58421 46689029 A  ERROR'
2018-10-30 12:58:09 [DEBUG   ] Got command BAM from MCS: ref #321564
2018-10-30 12:58:09 [INFO    ] Finished processing BAM request
2018-10-30 12:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321564   8 58421 46689033 A  ERROR'
2018-10-30 12:58:09 [INFO    ] Finished starting DRX
2018-10-30 12:58:09 [INFO    ] Finished starting DRX
2018-10-30 12:58:09 [INFO    ] Finished starting DRX
2018-10-30 12:58:09 [INFO    ] Finished starting DRX
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 12:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 12:58:09 [DEBUG   ] spawn_process: at 2018-10-30 12:58:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 12:58:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 12:58:32 [DEBUG   ] Got command BAM from MCS: ref #321568
2018-10-30 12:58:32 [INFO    ] Finished processing BAM request
2018-10-30 12:58:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321568   8 58421 46712045 A  ERROR'
2018-10-30 12:58:32 [DEBUG   ] Got command BAM from MCS: ref #321567
2018-10-30 12:58:32 [INFO    ] Finished processing BAM request
2018-10-30 12:58:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321567   8 58421 46712053 A  ERROR'
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 12:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 12:58:32 [DEBUG   ] spawn_process: at 2018-10-30 12:58:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 12:58:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 12:58:55 [DEBUG   ] Got command BAM from MCS: ref #321569
2018-10-30 12:58:55 [INFO    ] Finished processing BAM request
2018-10-30 12:58:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321569   8 58421 46735025 A  ERROR'
2018-10-30 12:58:55 [DEBUG   ] Got command BAM from MCS: ref #321570
2018-10-30 12:58:55 [INFO    ] Finished processing BAM request
2018-10-30 12:58:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321570   8 58421 46735029 A  ERROR'
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 12:58:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 12:58:55 [DEBUG   ] spawn_process: at 2018-10-30 12:58:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 12:59:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 12:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 12:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 12:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 12:59:02 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-10-30 12:59:18 [DEBUG   ] Got command BAM from MCS: ref #321572
2018-10-30 12:59:18 [INFO    ] Finished processing BAM request
2018-10-30 12:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321572   8 58421 46758030 A  ERROR'
2018-10-30 12:59:18 [DEBUG   ] Got command BAM from MCS: ref #321571
2018-10-30 12:59:18 [INFO    ] Finished processing BAM request
2018-10-30 12:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321571   8 58421 46758034 A  ERROR'
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 12:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 12:59:18 [DEBUG   ] spawn_process: at 2018-10-30 12:59:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 12:59:20 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-30 12:59:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 12:59:41 [DEBUG   ] Got command BAM from MCS: ref #321573
2018-10-30 12:59:41 [INFO    ] Finished processing BAM request
2018-10-30 12:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321573   8 58421 46781030 A  ERROR'
2018-10-30 12:59:41 [DEBUG   ] Got command BAM from MCS: ref #321574
2018-10-30 12:59:41 [INFO    ] Finished processing BAM request
2018-10-30 12:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 12:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321574   8 58421 46781034 A  ERROR'
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 12:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 12:59:41 [DEBUG   ] spawn_process: at 2018-10-30 12:59:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:00:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 13:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 13:00:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:00:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:00:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:00:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:00:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:00:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:00:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:00:03 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-30 13:00:04 [DEBUG   ] Got command BAM from MCS: ref #321575
2018-10-30 13:00:04 [INFO    ] Finished processing BAM request
2018-10-30 13:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321575   8 58421 46804025 A  ERROR'
2018-10-30 13:00:04 [DEBUG   ] Got command BAM from MCS: ref #321576
2018-10-30 13:00:04 [INFO    ] Finished processing BAM request
2018-10-30 13:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321576   8 58421 46804029 A  ERROR'
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:00:04 [DEBUG   ] spawn_process: at 2018-10-30 13:00:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #321577
2018-10-30 13:00:13 [DEBUG   ] summary = ERROR
2018-10-30 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321577  13 58421 46813345 A  ERRORERROR'
2018-10-30 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #321578
2018-10-30 13:00:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321578  77 58421 46813537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #321579
2018-10-30 13:00:13 [DEBUG   ] summary = ERROR
2018-10-30 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321579  13 58421 46813741 A  ERRORERROR'
2018-10-30 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #321580
2018-10-30 13:00:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321580  77 58421 46813945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:00:14 [DEBUG   ] Got command RPT from MCS: ref #321581
2018-10-30 13:00:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321581  12 58421 46814149 A  ERRORB ff'
2018-10-30 13:00:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 13:00:27 [DEBUG   ] Got command BAM from MCS: ref #321583
2018-10-30 13:00:27 [INFO    ] Finished processing BAM request
2018-10-30 13:00:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321583   8 58421 46827025 A  ERROR'
2018-10-30 13:00:27 [DEBUG   ] Got command BAM from MCS: ref #321582
2018-10-30 13:00:27 [INFO    ] Finished processing BAM request
2018-10-30 13:00:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321582   8 58421 46827029 A  ERROR'
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:00:27 [DEBUG   ] spawn_process: at 2018-10-30 13:00:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:00:39 [DEBUG   ] Got command RPT from MCS: ref #321588
2018-10-30 13:00:39 [DEBUG   ] summary = ERROR
2018-10-30 13:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321588  13 58421 46839829 A  ERRORERROR'
2018-10-30 13:00:39 [DEBUG   ] Got command RPT from MCS: ref #321589
2018-10-30 13:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321589  77 58421 46839830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:00:40 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 13:00:50 [DEBUG   ] Got command BAM from MCS: ref #321605
2018-10-30 13:00:50 [INFO    ] Finished processing BAM request
2018-10-30 13:00:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321605   8 58421 46850029 A  ERROR'
2018-10-30 13:00:50 [DEBUG   ] Got command BAM from MCS: ref #321606
2018-10-30 13:00:50 [INFO    ] Finished processing BAM request
2018-10-30 13:00:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321606   8 58421 46850033 A  ERROR'
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:00:50 [DEBUG   ] spawn_process: at 2018-10-30 13:00:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:01:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:01:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-30 13:01:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:01:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:01:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:01:02 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-10-30 13:01:13 [DEBUG   ] Got command BAM from MCS: ref #321607
2018-10-30 13:01:13 [INFO    ] Finished processing BAM request
2018-10-30 13:01:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321607   8 58421 46873029 A  ERROR'
2018-10-30 13:01:13 [DEBUG   ] Got command BAM from MCS: ref #321608
2018-10-30 13:01:13 [INFO    ] Finished processing BAM request
2018-10-30 13:01:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:01:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321608   8 58421 46873033 A  ERROR'
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:01:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:01:13 [DEBUG   ] spawn_process: at 2018-10-30 13:01:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:01:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:01:36 [DEBUG   ] Got command BAM from MCS: ref #321610
2018-10-30 13:01:36 [INFO    ] Finished processing BAM request
2018-10-30 13:01:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321610   8 58421 46896029 A  ERROR'
2018-10-30 13:01:36 [DEBUG   ] Got command BAM from MCS: ref #321609
2018-10-30 13:01:36 [INFO    ] Finished processing BAM request
2018-10-30 13:01:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321609   8 58421 46896033 A  ERROR'
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:01:36 [DEBUG   ] spawn_process: at 2018-10-30 13:01:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:01:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:01:59 [DEBUG   ] Got command BAM from MCS: ref #321612
2018-10-30 13:01:59 [INFO    ] Finished processing BAM request
2018-10-30 13:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321612   8 58421 46919029 A  ERROR'
2018-10-30 13:01:59 [DEBUG   ] Got command BAM from MCS: ref #321611
2018-10-30 13:01:59 [INFO    ] Finished processing BAM request
2018-10-30 13:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321611   8 58421 46919033 A  ERROR'
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:01:59 [DEBUG   ] spawn_process: at 2018-10-30 13:01:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:02:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 13:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:02:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:02:02 [DEBUG   ] Finished updating board flags in 1.266 seconds
2018-10-30 13:02:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:02:22 [DEBUG   ] Got command BAM from MCS: ref #321614
2018-10-30 13:02:22 [INFO    ] Finished processing BAM request
2018-10-30 13:02:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321614   8 58421 46942025 A  ERROR'
2018-10-30 13:02:22 [DEBUG   ] Got command BAM from MCS: ref #321613
2018-10-30 13:02:22 [INFO    ] Finished processing BAM request
2018-10-30 13:02:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321613   8 58421 46942029 A  ERROR'
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:02:22 [DEBUG   ] spawn_process: at 2018-10-30 13:02:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:02:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:02:45 [DEBUG   ] Got command BAM from MCS: ref #321616
2018-10-30 13:02:45 [INFO    ] Finished processing BAM request
2018-10-30 13:02:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:02:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321616   8 58421 46965033 A  ERROR'
2018-10-30 13:02:45 [DEBUG   ] Got command BAM from MCS: ref #321615
2018-10-30 13:02:45 [INFO    ] Finished processing BAM request
2018-10-30 13:02:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:02:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321615   8 58421 46965037 A  ERROR'
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:02:45 [DEBUG   ] spawn_process: at 2018-10-30 13:02:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:03:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:03:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:03:02 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-10-30 13:03:08 [DEBUG   ] Got command BAM from MCS: ref #321617
2018-10-30 13:03:08 [INFO    ] Finished processing BAM request
2018-10-30 13:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321617   8 58421 46988025 A  ERROR'
2018-10-30 13:03:08 [DEBUG   ] Got command BAM from MCS: ref #321618
2018-10-30 13:03:08 [INFO    ] Finished processing BAM request
2018-10-30 13:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321618   8 58421 46988029 A  ERROR'
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:03:08 [DEBUG   ] spawn_process: at 2018-10-30 13:03:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:03:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 13:03:31 [DEBUG   ] Got command BAM from MCS: ref #321620
2018-10-30 13:03:31 [INFO    ] Finished processing BAM request
2018-10-30 13:03:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321620   8 58421 47011033 A  ERROR'
2018-10-30 13:03:31 [DEBUG   ] Got command BAM from MCS: ref #321619
2018-10-30 13:03:31 [INFO    ] Finished processing BAM request
2018-10-30 13:03:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321619   8 58421 47011037 A  ERROR'
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:03:31 [DEBUG   ] spawn_process: at 2018-10-30 13:03:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:03:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:03:54 [DEBUG   ] Got command BAM from MCS: ref #321626
2018-10-30 13:03:54 [INFO    ] Finished processing BAM request
2018-10-30 13:03:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321626   8 58421 47034025 A  ERROR'
2018-10-30 13:03:54 [DEBUG   ] Got command BAM from MCS: ref #321625
2018-10-30 13:03:54 [INFO    ] Finished processing BAM request
2018-10-30 13:03:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321625   8 58421 47034029 A  ERROR'
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:03:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:03:54 [DEBUG   ] spawn_process: at 2018-10-30 13:03:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:04:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:04:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:04:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 13:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 13:04:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:04:02 [DEBUG   ] Finished updating board flags in 1.133 seconds
2018-10-30 13:04:17 [DEBUG   ] Got command BAM from MCS: ref #321628
2018-10-30 13:04:17 [INFO    ] Finished processing BAM request
2018-10-30 13:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321628   8 58421 47057029 A  ERROR'
2018-10-30 13:04:17 [DEBUG   ] Got command BAM from MCS: ref #321627
2018-10-30 13:04:17 [INFO    ] Finished processing BAM request
2018-10-30 13:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321627   8 58421 47057033 A  ERROR'
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:04:17 [DEBUG   ] spawn_process: at 2018-10-30 13:04:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:04:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:04:40 [DEBUG   ] Got command BAM from MCS: ref #321629
2018-10-30 13:04:40 [INFO    ] Finished processing BAM request
2018-10-30 13:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321629   8 58421 47080033 A  ERROR'
2018-10-30 13:04:40 [DEBUG   ] Got command BAM from MCS: ref #321630
2018-10-30 13:04:40 [INFO    ] Finished processing BAM request
2018-10-30 13:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321630   8 58421 47080037 A  ERROR'
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:04:40 [DEBUG   ] spawn_process: at 2018-10-30 13:04:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:04:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:05:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 13:05:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:05:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:05:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:05:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:05:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:05:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:05:02 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-10-30 13:05:03 [DEBUG   ] Got command BAM from MCS: ref #321634
2018-10-30 13:05:03 [INFO    ] Finished processing BAM request
2018-10-30 13:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321634   8 58421 47103025 A  ERROR'
2018-10-30 13:05:03 [DEBUG   ] Got command BAM from MCS: ref #321633
2018-10-30 13:05:03 [INFO    ] Finished processing BAM request
2018-10-30 13:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321633   8 58421 47103029 A  ERROR'
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:05:03 [DEBUG   ] spawn_process: at 2018-10-30 13:05:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #321635
2018-10-30 13:05:13 [DEBUG   ] summary = ERROR
2018-10-30 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321635  13 58421 47113425 A  ERRORERROR'
2018-10-30 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #321636
2018-10-30 13:05:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321636  77 58421 47113629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #321637
2018-10-30 13:05:13 [DEBUG   ] summary = ERROR
2018-10-30 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321637  13 58421 47113821 A  ERRORERROR'
2018-10-30 13:05:14 [DEBUG   ] Got command RPT from MCS: ref #321639
2018-10-30 13:05:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321639  77 58421 47114029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:05:14 [DEBUG   ] Got command RPT from MCS: ref #321640
2018-10-30 13:05:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321640  12 58421 47114233 A  ERRORBŁff'
2018-10-30 13:05:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:05:26 [DEBUG   ] Got command BAM from MCS: ref #321645
2018-10-30 13:05:26 [INFO    ] Finished processing BAM request
2018-10-30 13:05:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321645   8 58421 47126029 A  ERROR'
2018-10-30 13:05:26 [DEBUG   ] Got command BAM from MCS: ref #321646
2018-10-30 13:05:26 [INFO    ] Finished processing BAM request
2018-10-30 13:05:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321646   8 58421 47126033 A  ERROR'
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:05:26 [DEBUG   ] spawn_process: at 2018-10-30 13:05:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:05:39 [DEBUG   ] Got command RPT from MCS: ref #321647
2018-10-30 13:05:39 [DEBUG   ] summary = ERROR
2018-10-30 13:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321647  13 58421 47139833 A  ERRORERROR'
2018-10-30 13:05:39 [DEBUG   ] Got command RPT from MCS: ref #321648
2018-10-30 13:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321648  77 58421 47139834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:05:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:05:49 [DEBUG   ] Got command BAM from MCS: ref #321665
2018-10-30 13:05:49 [INFO    ] Finished processing BAM request
2018-10-30 13:05:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321665   8 58421 47149025 A  ERROR'
2018-10-30 13:05:49 [DEBUG   ] Got command BAM from MCS: ref #321664
2018-10-30 13:05:49 [INFO    ] Finished processing BAM request
2018-10-30 13:05:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321664   8 58421 47149029 A  ERROR'
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:05:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:05:49 [DEBUG   ] spawn_process: at 2018-10-30 13:05:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:06:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-30 13:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 13:06:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 13:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:06:02 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-10-30 13:06:12 [DEBUG   ] Got command BAM from MCS: ref #321667
2018-10-30 13:06:12 [INFO    ] Finished processing BAM request
2018-10-30 13:06:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321667   8 58421 47172025 A  ERROR'
2018-10-30 13:06:12 [DEBUG   ] Got command BAM from MCS: ref #321666
2018-10-30 13:06:12 [INFO    ] Finished processing BAM request
2018-10-30 13:06:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321666   8 58421 47172029 A  ERROR'
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:06:12 [DEBUG   ] spawn_process: at 2018-10-30 13:06:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:06:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:06:35 [DEBUG   ] Got command BAM from MCS: ref #321672
2018-10-30 13:06:35 [INFO    ] Finished processing BAM request
2018-10-30 13:06:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321672   8 58421 47195033 A  ERROR'
2018-10-30 13:06:35 [DEBUG   ] Got command BAM from MCS: ref #321673
2018-10-30 13:06:35 [INFO    ] Finished processing BAM request
2018-10-30 13:06:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321673   8 58421 47195037 A  ERROR'
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:06:35 [DEBUG   ] spawn_process: at 2018-10-30 13:06:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:06:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:06:58 [DEBUG   ] Got command BAM from MCS: ref #321674
2018-10-30 13:06:58 [INFO    ] Finished processing BAM request
2018-10-30 13:06:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321674   8 58421 47218025 A  ERROR'
2018-10-30 13:06:58 [DEBUG   ] Got command BAM from MCS: ref #321675
2018-10-30 13:06:58 [INFO    ] Finished processing BAM request
2018-10-30 13:06:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321675   8 58421 47218029 A  ERROR'
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:06:58 [DEBUG   ] spawn_process: at 2018-10-30 13:06:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:07:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 13:07:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 13:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:07:03 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-30 13:07:21 [DEBUG   ] Got command BAM from MCS: ref #321676
2018-10-30 13:07:21 [INFO    ] Finished processing BAM request
2018-10-30 13:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321676   8 58421 47241033 A  ERROR'
2018-10-30 13:07:21 [DEBUG   ] Got command BAM from MCS: ref #321677
2018-10-30 13:07:21 [INFO    ] Finished processing BAM request
2018-10-30 13:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321677   8 58421 47241037 A  ERROR'
2018-10-30 13:07:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:07:21 [DEBUG   ] spawn_process: at 2018-10-30 13:07:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:07:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:07:44 [DEBUG   ] Got command BAM from MCS: ref #321679
2018-10-30 13:07:44 [INFO    ] Finished processing BAM request
2018-10-30 13:07:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:07:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321679   8 58421 47264033 A  ERROR'
2018-10-30 13:07:44 [DEBUG   ] Got command BAM from MCS: ref #321678
2018-10-30 13:07:44 [INFO    ] Finished processing BAM request
2018-10-30 13:07:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:07:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321678   8 58421 47264037 A  ERROR'
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:07:44 [DEBUG   ] spawn_process: at 2018-10-30 13:07:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:08:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 13:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:08:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:08:03 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-10-30 13:08:07 [DEBUG   ] Got command BAM from MCS: ref #321680
2018-10-30 13:08:07 [INFO    ] Finished processing BAM request
2018-10-30 13:08:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:08:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321680   8 58421 47287033 A  ERROR'
2018-10-30 13:08:07 [DEBUG   ] Got command BAM from MCS: ref #321681
2018-10-30 13:08:07 [INFO    ] Finished processing BAM request
2018-10-30 13:08:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:08:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321681   8 58421 47287037 A  ERROR'
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:08:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:08:07 [DEBUG   ] spawn_process: at 2018-10-30 13:08:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:08:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:08:30 [DEBUG   ] Got command BAM from MCS: ref #321682
2018-10-30 13:08:30 [INFO    ] Finished processing BAM request
2018-10-30 13:08:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321682   8 58421 47310025 A  ERROR'
2018-10-30 13:08:30 [DEBUG   ] Got command BAM from MCS: ref #321683
2018-10-30 13:08:30 [INFO    ] Finished processing BAM request
2018-10-30 13:08:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321683   8 58421 47310029 A  ERROR'
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:08:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:08:30 [DEBUG   ] spawn_process: at 2018-10-30 13:08:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:08:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:08:53 [DEBUG   ] Got command BAM from MCS: ref #321684
2018-10-30 13:08:53 [INFO    ] Finished processing BAM request
2018-10-30 13:08:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321684   8 58421 47333029 A  ERROR'
2018-10-30 13:08:53 [DEBUG   ] Got command BAM from MCS: ref #321685
2018-10-30 13:08:53 [INFO    ] Finished processing BAM request
2018-10-30 13:08:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321685   8 58421 47333033 A  ERROR'
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:08:53 [DEBUG   ] spawn_process: at 2018-10-30 13:08:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:09:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 13:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 13:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:09:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:09:03 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-30 13:09:16 [DEBUG   ] Got command BAM from MCS: ref #321687
2018-10-30 13:09:16 [INFO    ] Finished processing BAM request
2018-10-30 13:09:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321687   8 58421 47356025 A  ERROR'
2018-10-30 13:09:16 [DEBUG   ] Got command BAM from MCS: ref #321686
2018-10-30 13:09:16 [INFO    ] Finished processing BAM request
2018-10-30 13:09:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321686   8 58421 47356029 A  ERROR'
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:09:16 [DEBUG   ] spawn_process: at 2018-10-30 13:09:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:09:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:09:39 [DEBUG   ] Got command BAM from MCS: ref #321693
2018-10-30 13:09:39 [INFO    ] Finished processing BAM request
2018-10-30 13:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321693   8 58421 47379029 A  ERROR'
2018-10-30 13:09:39 [DEBUG   ] Got command BAM from MCS: ref #321692
2018-10-30 13:09:39 [INFO    ] Finished processing BAM request
2018-10-30 13:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321692   8 58421 47379033 A  ERROR'
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:09:39 [DEBUG   ] spawn_process: at 2018-10-30 13:09:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:09:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:10:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:10:02 [DEBUG   ] Got command BAM from MCS: ref #321694
2018-10-30 13:10:02 [INFO    ] Finished processing BAM request
2018-10-30 13:10:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321694   8 58421 47402025 A  ERROR'
2018-10-30 13:10:02 [DEBUG   ] Got command BAM from MCS: ref #321695
2018-10-30 13:10:02 [INFO    ] Finished processing BAM request
2018-10-30 13:10:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321695   8 58421 47402029 A  ERROR'
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:10:02 [DEBUG   ] spawn_process: at 2018-10-30 13:10:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:10:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:10:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:10:03 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-30 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #321696
2018-10-30 13:10:13 [DEBUG   ] summary = ERROR
2018-10-30 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321696  13 58421 47413509 A  ERRORERROR'
2018-10-30 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #321697
2018-10-30 13:10:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321697  77 58421 47413713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #321698
2018-10-30 13:10:13 [DEBUG   ] summary = ERROR
2018-10-30 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321698  13 58421 47413917 A  ERRORERROR'
2018-10-30 13:10:14 [DEBUG   ] Got command RPT from MCS: ref #321699
2018-10-30 13:10:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321699  77 58421 47414109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:10:14 [DEBUG   ] Got command RPT from MCS: ref #321700
2018-10-30 13:10:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321700  12 58421 47414313 A  ERRORBŁff'
2018-10-30 13:10:21 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-30 13:10:25 [DEBUG   ] Got command BAM from MCS: ref #321701
2018-10-30 13:10:25 [INFO    ] Finished processing BAM request
2018-10-30 13:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321701   8 58421 47425029 A  ERROR'
2018-10-30 13:10:25 [DEBUG   ] Got command BAM from MCS: ref #321702
2018-10-30 13:10:25 [INFO    ] Finished processing BAM request
2018-10-30 13:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321702   8 58421 47425033 A  ERROR'
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:10:25 [DEBUG   ] spawn_process: at 2018-10-30 13:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:10:39 [DEBUG   ] Got command RPT from MCS: ref #321703
2018-10-30 13:10:39 [DEBUG   ] summary = ERROR
2018-10-30 13:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321703  13 58421 47439841 A  ERRORERROR'
2018-10-30 13:10:39 [DEBUG   ] Got command RPT from MCS: ref #321704
2018-10-30 13:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321704  77 58421 47439842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:10:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:10:48 [DEBUG   ] Got command BAM from MCS: ref #321721
2018-10-30 13:10:48 [INFO    ] Finished processing BAM request
2018-10-30 13:10:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321721   8 58421 47448033 A  ERROR'
2018-10-30 13:10:48 [DEBUG   ] Got command BAM from MCS: ref #321720
2018-10-30 13:10:48 [INFO    ] Finished processing BAM request
2018-10-30 13:10:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321720   8 58421 47448037 A  ERROR'
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:10:48 [DEBUG   ] spawn_process: at 2018-10-30 13:10:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:11:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:11:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-30 13:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:11:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:11:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:11:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 13:11:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:11:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:11:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:11:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:11:04 [DEBUG   ] Finished updating board flags in 1.956 seconds
2018-10-30 13:11:11 [DEBUG   ] Got command BAM from MCS: ref #321723
2018-10-30 13:11:11 [INFO    ] Finished processing BAM request
2018-10-30 13:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321723   8 58421 47471025 A  ERROR'
2018-10-30 13:11:11 [DEBUG   ] Got command BAM from MCS: ref #321722
2018-10-30 13:11:11 [INFO    ] Finished processing BAM request
2018-10-30 13:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321722   8 58421 47471029 A  ERROR'
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:11:11 [DEBUG   ] spawn_process: at 2018-10-30 13:11:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:11:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:11:34 [DEBUG   ] Got command BAM from MCS: ref #321724
2018-10-30 13:11:34 [INFO    ] Finished processing BAM request
2018-10-30 13:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321724   8 58421 47494025 A  ERROR'
2018-10-30 13:11:34 [DEBUG   ] Got command BAM from MCS: ref #321725
2018-10-30 13:11:34 [INFO    ] Finished processing BAM request
2018-10-30 13:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321725   8 58421 47494029 A  ERROR'
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:11:34 [DEBUG   ] spawn_process: at 2018-10-30 13:11:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:11:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:11:57 [DEBUG   ] Got command BAM from MCS: ref #321726
2018-10-30 13:11:57 [INFO    ] Finished processing BAM request
2018-10-30 13:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321726   8 58421 47517033 A  ERROR'
2018-10-30 13:11:57 [DEBUG   ] Got command BAM from MCS: ref #321727
2018-10-30 13:11:57 [INFO    ] Finished processing BAM request
2018-10-30 13:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321727   8 58421 47517037 A  ERROR'
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:11:57 [DEBUG   ] spawn_process: at 2018-10-30 13:11:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:12:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-30 13:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:12:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:12:03 [DEBUG   ] Finished updating board flags in 1.274 seconds
2018-10-30 13:12:20 [DEBUG   ] Got command BAM from MCS: ref #321728
2018-10-30 13:12:20 [INFO    ] Finished processing BAM request
2018-10-30 13:12:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321728   8 58421 47540029 A  ERROR'
2018-10-30 13:12:20 [DEBUG   ] Got command BAM from MCS: ref #321729
2018-10-30 13:12:20 [INFO    ] Finished processing BAM request
2018-10-30 13:12:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321729   8 58421 47540033 A  ERROR'
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:12:20 [DEBUG   ] spawn_process: at 2018-10-30 13:12:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:12:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:12:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:12:43 [DEBUG   ] Got command BAM from MCS: ref #321735
2018-10-30 13:12:43 [INFO    ] Finished processing BAM request
2018-10-30 13:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321735   8 58421 47563029 A  ERROR'
2018-10-30 13:12:43 [DEBUG   ] Got command BAM from MCS: ref #321734
2018-10-30 13:12:43 [INFO    ] Finished processing BAM request
2018-10-30 13:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321734   8 58421 47563033 A  ERROR'
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:12:43 [DEBUG   ] spawn_process: at 2018-10-30 13:12:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:13:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:13:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 13:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:13:03 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-10-30 13:13:06 [DEBUG   ] Got command BAM from MCS: ref #321736
2018-10-30 13:13:06 [INFO    ] Finished processing BAM request
2018-10-30 13:13:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321736   8 58421 47586033 A  ERROR'
2018-10-30 13:13:06 [DEBUG   ] Got command BAM from MCS: ref #321737
2018-10-30 13:13:06 [INFO    ] Finished processing BAM request
2018-10-30 13:13:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321737   8 58421 47586037 A  ERROR'
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:13:06 [DEBUG   ] spawn_process: at 2018-10-30 13:13:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:13:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 13:13:29 [DEBUG   ] Got command BAM from MCS: ref #321738
2018-10-30 13:13:29 [INFO    ] Finished processing BAM request
2018-10-30 13:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321738   8 58421 47609029 A  ERROR'
2018-10-30 13:13:29 [DEBUG   ] Got command BAM from MCS: ref #321739
2018-10-30 13:13:29 [INFO    ] Finished processing BAM request
2018-10-30 13:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321739   8 58421 47609033 A  ERROR'
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:13:29 [DEBUG   ] spawn_process: at 2018-10-30 13:13:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:13:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:13:52 [DEBUG   ] Got command BAM from MCS: ref #321740
2018-10-30 13:13:52 [INFO    ] Finished processing BAM request
2018-10-30 13:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321740   8 58421 47632049 A  ERROR'
2018-10-30 13:13:52 [DEBUG   ] Got command BAM from MCS: ref #321741
2018-10-30 13:13:52 [INFO    ] Finished processing BAM request
2018-10-30 13:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321741   8 58421 47632053 A  ERROR'
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:13:52 [DEBUG   ] spawn_process: at 2018-10-30 13:13:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:14:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:14:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:14:03 [DEBUG   ] Finished updating board flags in 1.132 seconds
2018-10-30 13:14:15 [DEBUG   ] Got command BAM from MCS: ref #321742
2018-10-30 13:14:15 [INFO    ] Finished processing BAM request
2018-10-30 13:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321742   8 58421 47655025 A  ERROR'
2018-10-30 13:14:15 [DEBUG   ] Got command BAM from MCS: ref #321743
2018-10-30 13:14:15 [INFO    ] Finished processing BAM request
2018-10-30 13:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321743   8 58421 47655029 A  ERROR'
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:14:15 [DEBUG   ] spawn_process: at 2018-10-30 13:14:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:14:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:14:38 [DEBUG   ] Got command BAM from MCS: ref #321745
2018-10-30 13:14:38 [INFO    ] Finished processing BAM request
2018-10-30 13:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321745   8 58421 47678025 A  ERROR'
2018-10-30 13:14:38 [DEBUG   ] Got command BAM from MCS: ref #321744
2018-10-30 13:14:38 [INFO    ] Finished processing BAM request
2018-10-30 13:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321744   8 58421 47678029 A  ERROR'
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:14:38 [DEBUG   ] spawn_process: at 2018-10-30 13:14:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:14:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:15:01 [DEBUG   ] Got command BAM from MCS: ref #321749
2018-10-30 13:15:01 [INFO    ] Finished processing BAM request
2018-10-30 13:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321749   8 58421 47701033 A  ERROR'
2018-10-30 13:15:01 [DEBUG   ] Got command BAM from MCS: ref #321748
2018-10-30 13:15:01 [INFO    ] Finished processing BAM request
2018-10-30 13:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321748   8 58421 47701037 A  ERROR'
2018-10-30 13:15:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:15:01 [DEBUG   ] spawn_process: at 2018-10-30 13:15:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:15:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:15:03 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-10-30 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #321750
2018-10-30 13:15:13 [DEBUG   ] summary = ERROR
2018-10-30 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321750  13 58421 47713601 A  ERRORERROR'
2018-10-30 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #321751
2018-10-30 13:15:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321751  77 58421 47713795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #321752
2018-10-30 13:15:13 [DEBUG   ] summary = ERROR
2018-10-30 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321752  13 58421 47713997 A  ERRORERROR'
2018-10-30 13:15:14 [DEBUG   ] Got command RPT from MCS: ref #321754
2018-10-30 13:15:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321754  77 58421 47714201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:15:14 [DEBUG   ] Got command RPT from MCS: ref #321755
2018-10-30 13:15:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321755  12 58421 47714405 A  ERRORB˘ff'
2018-10-30 13:15:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 13:15:24 [DEBUG   ] Got command BAM from MCS: ref #321761
2018-10-30 13:15:24 [INFO    ] Finished processing BAM request
2018-10-30 13:15:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321761   8 58421 47724033 A  ERROR'
2018-10-30 13:15:24 [DEBUG   ] Got command BAM from MCS: ref #321760
2018-10-30 13:15:24 [INFO    ] Finished processing BAM request
2018-10-30 13:15:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321760   8 58421 47724037 A  ERROR'
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:15:24 [DEBUG   ] spawn_process: at 2018-10-30 13:15:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:15:39 [DEBUG   ] Got command RPT from MCS: ref #321766
2018-10-30 13:15:39 [DEBUG   ] summary = ERROR
2018-10-30 13:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321766  13 58421 47739841 A  ERRORERROR'
2018-10-30 13:15:39 [DEBUG   ] Got command RPT from MCS: ref #321767
2018-10-30 13:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321767  77 58421 47739842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:15:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 13:15:47 [DEBUG   ] Got command BAM from MCS: ref #321783
2018-10-30 13:15:47 [INFO    ] Finished processing BAM request
2018-10-30 13:15:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:15:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321783   8 58421 47747033 A  ERROR'
2018-10-30 13:15:47 [DEBUG   ] Got command BAM from MCS: ref #321784
2018-10-30 13:15:47 [INFO    ] Finished processing BAM request
2018-10-30 13:15:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:15:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321784   8 58421 47747037 A  ERROR'
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:15:47 [DEBUG   ] spawn_process: at 2018-10-30 13:15:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:16:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 13:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:16:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 13:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 13:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:16:03 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-10-30 13:16:10 [DEBUG   ] Got command BAM from MCS: ref #321785
2018-10-30 13:16:10 [INFO    ] Finished processing BAM request
2018-10-30 13:16:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321785   8 58421 47770025 A  ERROR'
2018-10-30 13:16:10 [DEBUG   ] Got command BAM from MCS: ref #321786
2018-10-30 13:16:10 [INFO    ] Finished processing BAM request
2018-10-30 13:16:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321786   8 58421 47770029 A  ERROR'
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:16:10 [DEBUG   ] spawn_process: at 2018-10-30 13:16:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:16:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 13:16:33 [DEBUG   ] Got command BAM from MCS: ref #321788
2018-10-30 13:16:33 [INFO    ] Finished processing BAM request
2018-10-30 13:16:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321788   8 58421 47793033 A  ERROR'
2018-10-30 13:16:33 [DEBUG   ] Got command BAM from MCS: ref #321787
2018-10-30 13:16:33 [INFO    ] Finished processing BAM request
2018-10-30 13:16:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321787   8 58421 47793041 A  ERROR'
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:16:33 [DEBUG   ] spawn_process: at 2018-10-30 13:16:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:16:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 13:16:56 [DEBUG   ] Got command BAM from MCS: ref #321790
2018-10-30 13:16:56 [INFO    ] Finished processing BAM request
2018-10-30 13:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321790   8 58421 47816033 A  ERROR'
2018-10-30 13:16:56 [DEBUG   ] Got command BAM from MCS: ref #321789
2018-10-30 13:16:56 [INFO    ] Finished processing BAM request
2018-10-30 13:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321789   8 58421 47816037 A  ERROR'
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:16:56 [DEBUG   ] spawn_process: at 2018-10-30 13:16:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:17:01 [DEBUG   ] Finished updating ant stats in 0.443 seconds
2018-10-30 13:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 13:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 13:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:17:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:17:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:17:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:17:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:17:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:17:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:17:04 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-10-30 13:17:19 [DEBUG   ] Got command BAM from MCS: ref #321791
2018-10-30 13:17:19 [INFO    ] Finished processing BAM request
2018-10-30 13:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321791   8 58421 47839033 A  ERROR'
2018-10-30 13:17:19 [DEBUG   ] Got command BAM from MCS: ref #321792
2018-10-30 13:17:19 [INFO    ] Finished processing BAM request
2018-10-30 13:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321792   8 58421 47839037 A  ERROR'
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:17:19 [DEBUG   ] spawn_process: at 2018-10-30 13:17:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:17:21 [DEBUG   ] Finished updating ant stats in 0.358 seconds
2018-10-30 13:17:42 [DEBUG   ] Got command BAM from MCS: ref #321794
2018-10-30 13:17:42 [INFO    ] Finished processing BAM request
2018-10-30 13:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321794   8 58421 47862029 A  ERROR'
2018-10-30 13:17:42 [DEBUG   ] Got command BAM from MCS: ref #321793
2018-10-30 13:17:42 [INFO    ] Finished processing BAM request
2018-10-30 13:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321793   8 58421 47862033 A  ERROR'
2018-10-30 13:17:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:17:42 [DEBUG   ] spawn_process: at 2018-10-30 13:17:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:18:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 13:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:18:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:18:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:18:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:18:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:18:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:18:04 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-10-30 13:18:05 [DEBUG   ] Got command BAM from MCS: ref #321796
2018-10-30 13:18:05 [INFO    ] Finished processing BAM request
2018-10-30 13:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321796   8 58421 47885033 A  ERROR'
2018-10-30 13:18:05 [DEBUG   ] Got command BAM from MCS: ref #321795
2018-10-30 13:18:05 [INFO    ] Finished processing BAM request
2018-10-30 13:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321795   8 58421 47885037 A  ERROR'
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:18:05 [DEBUG   ] spawn_process: at 2018-10-30 13:18:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:18:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:18:28 [DEBUG   ] Got command BAM from MCS: ref #321797
2018-10-30 13:18:28 [INFO    ] Finished processing BAM request
2018-10-30 13:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321797   8 58421 47908033 A  ERROR'
2018-10-30 13:18:28 [DEBUG   ] Got command BAM from MCS: ref #321798
2018-10-30 13:18:28 [INFO    ] Finished processing BAM request
2018-10-30 13:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321798   8 58421 47908037 A  ERROR'
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:18:28 [DEBUG   ] spawn_process: at 2018-10-30 13:18:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:18:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:18:51 [DEBUG   ] Got command BAM from MCS: ref #321804
2018-10-30 13:18:51 [INFO    ] Finished processing BAM request
2018-10-30 13:18:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321804   8 58421 47931033 A  ERROR'
2018-10-30 13:18:51 [DEBUG   ] Got command BAM from MCS: ref #321803
2018-10-30 13:18:51 [INFO    ] Finished processing BAM request
2018-10-30 13:18:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321803   8 58421 47931037 A  ERROR'
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:18:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:18:51 [DEBUG   ] spawn_process: at 2018-10-30 13:18:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:19:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 13:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 13:19:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:19:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:19:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:19:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:19:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:19:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:19:04 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-30 13:19:14 [DEBUG   ] Got command BAM from MCS: ref #321806
2018-10-30 13:19:14 [INFO    ] Finished processing BAM request
2018-10-30 13:19:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321806   8 58421 47954025 A  ERROR'
2018-10-30 13:19:14 [DEBUG   ] Got command BAM from MCS: ref #321805
2018-10-30 13:19:14 [INFO    ] Finished processing BAM request
2018-10-30 13:19:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321805   8 58421 47954029 A  ERROR'
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:19:14 [DEBUG   ] spawn_process: at 2018-10-30 13:19:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:19:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:19:37 [DEBUG   ] Got command BAM from MCS: ref #321807
2018-10-30 13:19:37 [INFO    ] Finished processing BAM request
2018-10-30 13:19:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321807   8 58421 47977029 A  ERROR'
2018-10-30 13:19:37 [DEBUG   ] Got command BAM from MCS: ref #321808
2018-10-30 13:19:37 [INFO    ] Finished processing BAM request
2018-10-30 13:19:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321808   8 58421 47977033 A  ERROR'
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:19:37 [DEBUG   ] spawn_process: at 2018-10-30 13:19:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:19:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:20:00 [DEBUG   ] Got command BAM from MCS: ref #321809
2018-10-30 13:20:00 [INFO    ] Finished processing BAM request
2018-10-30 13:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321809   8 58421 48000033 A  ERROR'
2018-10-30 13:20:00 [DEBUG   ] Got command BAM from MCS: ref #321810
2018-10-30 13:20:00 [INFO    ] Finished processing BAM request
2018-10-30 13:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321810   8 58421 48000037 A  ERROR'
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:20:00 [DEBUG   ] spawn_process: at 2018-10-30 13:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:20:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 13:20:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:20:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:20:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:20:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:20:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:20:04 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-10-30 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #321811
2018-10-30 13:20:13 [DEBUG   ] summary = ERROR
2018-10-30 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321811  13 58421 48013681 A  ERRORERROR'
2018-10-30 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #321812
2018-10-30 13:20:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321812  77 58421 48013885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:20:14 [DEBUG   ] Got command RPT from MCS: ref #321813
2018-10-30 13:20:14 [DEBUG   ] summary = ERROR
2018-10-30 13:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321813  13 58421 48014089 A  ERRORERROR'
2018-10-30 13:20:14 [DEBUG   ] Got command RPT from MCS: ref #321814
2018-10-30 13:20:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321814  77 58421 48014281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:20:14 [DEBUG   ] Got command RPT from MCS: ref #321815
2018-10-30 13:20:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321815  12 58421 48014485 A  ERRORBŁff'
2018-10-30 13:20:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:20:23 [DEBUG   ] Got command BAM from MCS: ref #321816
2018-10-30 13:20:23 [INFO    ] Finished processing BAM request
2018-10-30 13:20:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321816   8 58421 48023029 A  ERROR'
2018-10-30 13:20:23 [DEBUG   ] Got command BAM from MCS: ref #321817
2018-10-30 13:20:23 [INFO    ] Finished processing BAM request
2018-10-30 13:20:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321817   8 58421 48023033 A  ERROR'
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:20:23 [DEBUG   ] spawn_process: at 2018-10-30 13:20:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:20:39 [DEBUG   ] Got command RPT from MCS: ref #321818
2018-10-30 13:20:39 [DEBUG   ] summary = ERROR
2018-10-30 13:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321818  13 58421 48039833 A  ERRORERROR'
2018-10-30 13:20:39 [DEBUG   ] Got command RPT from MCS: ref #321819
2018-10-30 13:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321819  77 58421 48039834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:20:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:20:46 [DEBUG   ] Got command BAM from MCS: ref #321836
2018-10-30 13:20:46 [INFO    ] Finished processing BAM request
2018-10-30 13:20:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:20:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321836   8 58421 48046025 A  ERROR'
2018-10-30 13:20:46 [DEBUG   ] Got command BAM from MCS: ref #321835
2018-10-30 13:20:46 [INFO    ] Finished processing BAM request
2018-10-30 13:20:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:20:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321835   8 58421 48046029 A  ERROR'
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:20:46 [DEBUG   ] spawn_process: at 2018-10-30 13:20:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:21:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 13:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:21:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:21:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:21:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:21:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:21:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:21:04 [DEBUG   ] Finished updating board flags in 1.284 seconds
2018-10-30 13:21:09 [DEBUG   ] Got command BAM from MCS: ref #321837
2018-10-30 13:21:09 [INFO    ] Finished processing BAM request
2018-10-30 13:21:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321837   8 58421 48069033 A  ERROR'
2018-10-30 13:21:09 [DEBUG   ] Got command BAM from MCS: ref #321838
2018-10-30 13:21:09 [INFO    ] Finished processing BAM request
2018-10-30 13:21:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321838   8 58421 48069037 A  ERROR'
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:21:09 [DEBUG   ] spawn_process: at 2018-10-30 13:21:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:21:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:21:32 [DEBUG   ] Got command BAM from MCS: ref #321839
2018-10-30 13:21:32 [INFO    ] Finished processing BAM request
2018-10-30 13:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321839   8 58421 48092033 A  ERROR'
2018-10-30 13:21:32 [DEBUG   ] Got command BAM from MCS: ref #321840
2018-10-30 13:21:32 [INFO    ] Finished processing BAM request
2018-10-30 13:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321840   8 58421 48092037 A  ERROR'
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:21:32 [DEBUG   ] spawn_process: at 2018-10-30 13:21:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:21:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:21:55 [DEBUG   ] Got command BAM from MCS: ref #321845
2018-10-30 13:21:55 [INFO    ] Finished processing BAM request
2018-10-30 13:21:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321845   8 58421 48115029 A  ERROR'
2018-10-30 13:21:55 [DEBUG   ] Got command BAM from MCS: ref #321846
2018-10-30 13:21:55 [INFO    ] Finished processing BAM request
2018-10-30 13:21:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321846   8 58421 48115033 A  ERROR'
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:21:55 [DEBUG   ] spawn_process: at 2018-10-30 13:21:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:22:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:22:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:22:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 13:22:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:22:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:22:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:22:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:22:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:22:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:22:05 [DEBUG   ] Finished updating board flags in 1.755 seconds
2018-10-30 13:22:18 [DEBUG   ] Got command BAM from MCS: ref #321847
2018-10-30 13:22:18 [INFO    ] Finished processing BAM request
2018-10-30 13:22:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321847   8 58421 48138033 A  ERROR'
2018-10-30 13:22:18 [DEBUG   ] Got command BAM from MCS: ref #321848
2018-10-30 13:22:18 [INFO    ] Finished processing BAM request
2018-10-30 13:22:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321848   8 58421 48138037 A  ERROR'
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:22:18 [DEBUG   ] spawn_process: at 2018-10-30 13:22:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:22:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:22:41 [DEBUG   ] Got command BAM from MCS: ref #321849
2018-10-30 13:22:41 [INFO    ] Finished processing BAM request
2018-10-30 13:22:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321849   8 58421 48161025 A  ERROR'
2018-10-30 13:22:41 [DEBUG   ] Got command BAM from MCS: ref #321850
2018-10-30 13:22:41 [INFO    ] Finished processing BAM request
2018-10-30 13:22:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321850   8 58421 48161029 A  ERROR'
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:22:41 [DEBUG   ] spawn_process: at 2018-10-30 13:22:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:22:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:23:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:23:04 [DEBUG   ] Got command BAM from MCS: ref #321851
2018-10-30 13:23:04 [INFO    ] Finished processing BAM request
2018-10-30 13:23:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321851   8 58421 48184029 A  ERROR'
2018-10-30 13:23:04 [DEBUG   ] Got command BAM from MCS: ref #321852
2018-10-30 13:23:04 [INFO    ] Finished processing BAM request
2018-10-30 13:23:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321852   8 58421 48184033 A  ERROR'
2018-10-30 13:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:23:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:23:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:23:04 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:23:04 [DEBUG   ] spawn_process: at 2018-10-30 13:23:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:23:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:23:27 [DEBUG   ] Got command BAM from MCS: ref #321853
2018-10-30 13:23:27 [INFO    ] Finished processing BAM request
2018-10-30 13:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321853   8 58421 48207029 A  ERROR'
2018-10-30 13:23:27 [DEBUG   ] Got command BAM from MCS: ref #321854
2018-10-30 13:23:27 [INFO    ] Finished processing BAM request
2018-10-30 13:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321854   8 58421 48207033 A  ERROR'
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:23:27 [DEBUG   ] spawn_process: at 2018-10-30 13:23:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:23:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:23:50 [DEBUG   ] Got command BAM from MCS: ref #321856
2018-10-30 13:23:50 [INFO    ] Finished processing BAM request
2018-10-30 13:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321856   8 58421 48230029 A  ERROR'
2018-10-30 13:23:50 [DEBUG   ] Got command BAM from MCS: ref #321855
2018-10-30 13:23:50 [INFO    ] Finished processing BAM request
2018-10-30 13:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321855   8 58421 48230033 A  ERROR'
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:23:50 [DEBUG   ] spawn_process: at 2018-10-30 13:23:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:24:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 13:24:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:24:04 [DEBUG   ] Finished updating board flags in 1.044 seconds
2018-10-30 13:24:13 [DEBUG   ] Got command BAM from MCS: ref #321858
2018-10-30 13:24:13 [INFO    ] Finished processing BAM request
2018-10-30 13:24:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321858   8 58421 48253029 A  ERROR'
2018-10-30 13:24:13 [DEBUG   ] Got command BAM from MCS: ref #321857
2018-10-30 13:24:13 [INFO    ] Finished processing BAM request
2018-10-30 13:24:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321857   8 58421 48253037 A  ERROR'
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:24:13 [DEBUG   ] spawn_process: at 2018-10-30 13:24:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:24:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:24:36 [DEBUG   ] Got command BAM from MCS: ref #321864
2018-10-30 13:24:36 [INFO    ] Finished processing BAM request
2018-10-30 13:24:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321864   8 58421 48276029 A  ERROR'
2018-10-30 13:24:36 [DEBUG   ] Got command BAM from MCS: ref #321863
2018-10-30 13:24:36 [INFO    ] Finished processing BAM request
2018-10-30 13:24:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321863   8 58421 48276033 A  ERROR'
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:24:36 [DEBUG   ] spawn_process: at 2018-10-30 13:24:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:24:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:24:59 [DEBUG   ] Got command BAM from MCS: ref #321867
2018-10-30 13:24:59 [INFO    ] Finished processing BAM request
2018-10-30 13:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321867   8 58421 48299025 A  ERROR'
2018-10-30 13:24:59 [DEBUG   ] Got command BAM from MCS: ref #321868
2018-10-30 13:24:59 [INFO    ] Finished processing BAM request
2018-10-30 13:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321868   8 58421 48299029 A  ERROR'
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:24:59 [DEBUG   ] spawn_process: at 2018-10-30 13:24:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:25:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 13:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 13:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:25:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 13:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:25:04 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-10-30 13:25:13 [DEBUG   ] Got command RPT from MCS: ref #321869
2018-10-30 13:25:13 [DEBUG   ] summary = ERROR
2018-10-30 13:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321869  13 58421 48313769 A  ERRORERROR'
2018-10-30 13:25:13 [DEBUG   ] Got command RPT from MCS: ref #321870
2018-10-30 13:25:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321870  77 58421 48313973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:25:14 [DEBUG   ] Got command RPT from MCS: ref #321871
2018-10-30 13:25:14 [DEBUG   ] summary = ERROR
2018-10-30 13:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321871  13 58421 48314165 A  ERRORERROR'
2018-10-30 13:25:14 [DEBUG   ] Got command RPT from MCS: ref #321873
2018-10-30 13:25:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321873  77 58421 48314369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:25:14 [DEBUG   ] Got command RPT from MCS: ref #321874
2018-10-30 13:25:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321874  12 58421 48314573 A  ERRORBŁff'
2018-10-30 13:25:22 [DEBUG   ] Got command BAM from MCS: ref #321880
2018-10-30 13:25:22 [INFO    ] Finished processing BAM request
2018-10-30 13:25:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321880   8 58421 48322029 A  ERROR'
2018-10-30 13:25:22 [DEBUG   ] Got command BAM from MCS: ref #321879
2018-10-30 13:25:22 [INFO    ] Finished processing BAM request
2018-10-30 13:25:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321879   8 58421 48322033 A  ERROR'
2018-10-30 13:25:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:25:22 [DEBUG   ] spawn_process: at 2018-10-30 13:25:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:25:39 [DEBUG   ] Got command RPT from MCS: ref #321881
2018-10-30 13:25:39 [DEBUG   ] summary = ERROR
2018-10-30 13:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321881  13 58421 48339841 A  ERRORERROR'
2018-10-30 13:25:39 [DEBUG   ] Got command RPT from MCS: ref #321882
2018-10-30 13:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321882  77 58421 48339842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:25:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:25:45 [DEBUG   ] Got command BAM from MCS: ref #321899
2018-10-30 13:25:45 [INFO    ] Finished processing BAM request
2018-10-30 13:25:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321899   8 58421 48345029 A  ERROR'
2018-10-30 13:25:45 [DEBUG   ] Got command BAM from MCS: ref #321898
2018-10-30 13:25:45 [INFO    ] Finished processing BAM request
2018-10-30 13:25:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321898   8 58421 48345033 A  ERROR'
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:25:45 [DEBUG   ] spawn_process: at 2018-10-30 13:25:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:26:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:26:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-30 13:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:26:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 13:26:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:26:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 13:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 13:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:26:04 [DEBUG   ] Finished updating board flags in 0.923 seconds
2018-10-30 13:26:08 [DEBUG   ] Got command BAM from MCS: ref #321900
2018-10-30 13:26:08 [INFO    ] Finished processing BAM request
2018-10-30 13:26:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321900   8 58421 48368029 A  ERROR'
2018-10-30 13:26:08 [DEBUG   ] Got command BAM from MCS: ref #321901
2018-10-30 13:26:08 [INFO    ] Finished processing BAM request
2018-10-30 13:26:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:26:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321901   8 58421 48368033 A  ERROR'
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:26:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:26:08 [DEBUG   ] spawn_process: at 2018-10-30 13:26:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:26:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:26:31 [DEBUG   ] Got command BAM from MCS: ref #321903
2018-10-30 13:26:31 [INFO    ] Finished processing BAM request
2018-10-30 13:26:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321903   8 58421 48391025 A  ERROR'
2018-10-30 13:26:31 [DEBUG   ] Got command BAM from MCS: ref #321902
2018-10-30 13:26:31 [INFO    ] Finished processing BAM request
2018-10-30 13:26:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321902   8 58421 48391029 A  ERROR'
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:26:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:26:31 [DEBUG   ] spawn_process: at 2018-10-30 13:26:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:26:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:26:54 [DEBUG   ] Got command BAM from MCS: ref #321905
2018-10-30 13:26:54 [INFO    ] Finished processing BAM request
2018-10-30 13:26:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321905   8 58421 48414029 A  ERROR'
2018-10-30 13:26:54 [DEBUG   ] Got command BAM from MCS: ref #321904
2018-10-30 13:26:54 [INFO    ] Finished processing BAM request
2018-10-30 13:26:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321904   8 58421 48414033 A  ERROR'
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 13:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 13:26:54 [DEBUG   ] spawn_process: at 2018-10-30 13:26:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 13:27:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:27:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:27:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:27:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:27:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:27:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:27:05 [DEBUG   ] Finished updating board flags in 1.740 seconds
2018-10-30 13:27:17 [DEBUG   ] Got command BAM from MCS: ref #321906
2018-10-30 13:27:17 [INFO    ] Finished processing BAM request
2018-10-30 13:27:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321906   8 58421 48437029 A  ERROR'
2018-10-30 13:27:17 [DEBUG   ] Got command BAM from MCS: ref #321907
2018-10-30 13:27:17 [INFO    ] Finished processing BAM request
2018-10-30 13:27:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321907   8 58421 48437033 A  ERROR'
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 13:27:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 13:27:17 [DEBUG   ] spawn_process: at 2018-10-30 13:27:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 13:27:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:27:40 [DEBUG   ] Got command BAM from MCS: ref #321913
2018-10-30 13:27:40 [INFO    ] Finished processing BAM request
2018-10-30 13:27:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321913   8 58421 48460029 A  ERROR'
2018-10-30 13:27:40 [DEBUG   ] Got command BAM from MCS: ref #321912
2018-10-30 13:27:40 [INFO    ] Finished processing BAM request
2018-10-30 13:27:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321912   8 58421 48460033 A  ERROR'
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 13:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 13:27:40 [DEBUG   ] spawn_process: at 2018-10-30 13:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 13:27:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:28:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:28:03 [DEBUG   ] Got command BAM from MCS: ref #321915
2018-10-30 13:28:03 [INFO    ] Finished processing BAM request
2018-10-30 13:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321915   8 58421 48483033 A  ERROR'
2018-10-30 13:28:03 [DEBUG   ] Got command BAM from MCS: ref #321914
2018-10-30 13:28:03 [INFO    ] Finished processing BAM request
2018-10-30 13:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 13:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   321914   8 58421 48483037 A  ERROR'
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 13:28:03 [DEBUG   ] spawn_process: at 2018-10-30 13:28:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 13:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:28:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 13:28:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:28:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:28:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:28:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:28:05 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-10-30 13:28:11 [DEBUG   ] Got command STP from MCS: ref #321916
2018-10-30 13:28:11 [INFO    ] Finished processing BAM request
2018-10-30 13:28:11 [INFO    ] Shutdown the adder chain on beam #3
2018-10-30 13:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   321916   8 58421 48491033 A  ERROR'
2018-10-30 13:28:11 [DEBUG   ] Got command STP from MCS: ref #321917
2018-10-30 13:28:11 [INFO    ] Finished processing BAM request
2018-10-30 13:28:11 [INFO    ] Shutdown the adder chain on beam #2
2018-10-30 13:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   321917   8 58421 48491037 A  ERROR'
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 13:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 13:28:11 [DEBUG   ] spawn_process: at 2018-10-30 13:28:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 13:28:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:28:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:29:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:29:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:29:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:29:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:29:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:29:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:29:05 [DEBUG   ] Finished updating board flags in 1.231 seconds
2018-10-30 13:29:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:29:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:30:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:30:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:30:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:30:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:30:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:30:05 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-10-30 13:30:13 [DEBUG   ] Got command RPT from MCS: ref #321918
2018-10-30 13:30:13 [DEBUG   ] summary = ERROR
2018-10-30 13:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321918  13 58421 48613857 A  ERRORERROR'
2018-10-30 13:30:14 [DEBUG   ] Got command RPT from MCS: ref #321919
2018-10-30 13:30:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321919  77 58421 48614061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:30:14 [DEBUG   ] Got command RPT from MCS: ref #321920
2018-10-30 13:30:14 [DEBUG   ] summary = ERROR
2018-10-30 13:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321920  13 58421 48614253 A  ERRORERROR'
2018-10-30 13:30:14 [DEBUG   ] Got command RPT from MCS: ref #321921
2018-10-30 13:30:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321921  77 58421 48614457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:30:14 [DEBUG   ] Got command RPT from MCS: ref #321922
2018-10-30 13:30:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321922  12 58421 48614661 A  ERRORB'
2018-10-30 13:30:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:30:39 [DEBUG   ] Got command RPT from MCS: ref #321927
2018-10-30 13:30:39 [DEBUG   ] summary = ERROR
2018-10-30 13:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321927  13 58421 48639841 A  ERRORERROR'
2018-10-30 13:30:39 [DEBUG   ] Got command RPT from MCS: ref #321928
2018-10-30 13:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321928  77 58421 48639842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:30:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:31:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:31:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 13:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:31:05 [DEBUG   ] Finished updating board flags in 1.164 seconds
2018-10-30 13:31:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:31:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:32:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:32:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:32:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:32:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:32:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:32:05 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-10-30 13:32:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:32:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:33:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 13:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:33:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:33:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:33:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:33:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:33:06 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-30 13:33:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:33:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:34:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:34:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:34:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:34:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:34:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:34:05 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-30 13:34:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:34:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:35:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:35:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:35:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:35:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:35:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:35:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:35:05 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-10-30 13:35:13 [DEBUG   ] Got command RPT from MCS: ref #321950
2018-10-30 13:35:13 [DEBUG   ] summary = ERROR
2018-10-30 13:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321950  13 58421 48913941 A  ERRORERROR'
2018-10-30 13:35:14 [DEBUG   ] Got command RPT from MCS: ref #321951
2018-10-30 13:35:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321951  77 58421 48914145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:35:14 [DEBUG   ] Got command RPT from MCS: ref #321952
2018-10-30 13:35:14 [DEBUG   ] summary = ERROR
2018-10-30 13:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321952  13 58421 48914337 A  ERRORERROR'
2018-10-30 13:35:14 [DEBUG   ] Got command RPT from MCS: ref #321954
2018-10-30 13:35:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321954  77 58421 48914541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:35:14 [DEBUG   ] Got command RPT from MCS: ref #321955
2018-10-30 13:35:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321955  12 58421 48914745 A  ERRORB'
2018-10-30 13:35:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:35:39 [DEBUG   ] Got command RPT from MCS: ref #321960
2018-10-30 13:35:39 [DEBUG   ] summary = ERROR
2018-10-30 13:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321960  13 58421 48939841 A  ERRORERROR'
2018-10-30 13:35:39 [DEBUG   ] Got command RPT from MCS: ref #321961
2018-10-30 13:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321961  77 58421 48939842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:35:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:36:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:36:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:36:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:36:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:36:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:36:05 [DEBUG   ] Finished updating board flags in 1.328 seconds
2018-10-30 13:36:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 13:36:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:37:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:37:05 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-10-30 13:37:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:37:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:38:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 13:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:38:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:38:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:38:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:38:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:38:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:38:06 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-30 13:38:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 13:38:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:39:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 13:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:39:05 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-10-30 13:39:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:39:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:40:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 13:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:40:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:40:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:40:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:40:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:40:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:40:06 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-30 13:40:14 [DEBUG   ] Got command RPT from MCS: ref #321985
2018-10-30 13:40:14 [DEBUG   ] summary = ERROR
2018-10-30 13:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321985  13 58421 49214021 A  ERRORERROR'
2018-10-30 13:40:14 [DEBUG   ] Got command RPT from MCS: ref #321986
2018-10-30 13:40:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321986  77 58421 49214225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:40:14 [DEBUG   ] Got command RPT from MCS: ref #321987
2018-10-30 13:40:14 [DEBUG   ] summary = ERROR
2018-10-30 13:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321987  13 58421 49214429 A  ERRORERROR'
2018-10-30 13:40:14 [DEBUG   ] Got command RPT from MCS: ref #321988
2018-10-30 13:40:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321988  77 58421 49214633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:40:14 [DEBUG   ] Got command RPT from MCS: ref #321989
2018-10-30 13:40:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321989  12 58421 49214825 A  ERRORB'
2018-10-30 13:40:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:40:39 [DEBUG   ] Got command RPT from MCS: ref #321990
2018-10-30 13:40:39 [DEBUG   ] summary = ERROR
2018-10-30 13:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321990  13 58421 49239845 A  ERRORERROR'
2018-10-30 13:40:39 [DEBUG   ] Got command RPT from MCS: ref #321991
2018-10-30 13:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   321991  77 58421 49239846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:40:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:41:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:41:06 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-30 13:41:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:41:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:42:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 13:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:42:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:42:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:42:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:42:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:42:06 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-30 13:42:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:42:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:43:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:43:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:43:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:43:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:43:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:43:06 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-30 13:43:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:43:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:44:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:44:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:44:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:44:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:44:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:44:06 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-10-30 13:44:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:44:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:45:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:45:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:45:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:45:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:45:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:45:06 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-30 13:45:14 [DEBUG   ] Got command RPT from MCS: ref #322013
2018-10-30 13:45:14 [DEBUG   ] summary = ERROR
2018-10-30 13:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322013  13 58421 49514117 A  ERRORERROR'
2018-10-30 13:45:14 [DEBUG   ] Got command RPT from MCS: ref #322014
2018-10-30 13:45:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322014  77 58421 49514309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:45:14 [DEBUG   ] Got command RPT from MCS: ref #322015
2018-10-30 13:45:14 [DEBUG   ] summary = ERROR
2018-10-30 13:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322015  13 58421 49514513 A  ERRORERROR'
2018-10-30 13:45:14 [DEBUG   ] Got command RPT from MCS: ref #322017
2018-10-30 13:45:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322017  77 58421 49514717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:45:14 [DEBUG   ] Got command RPT from MCS: ref #322019
2018-10-30 13:45:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322019  12 58421 49514921 A  ERRORB'
2018-10-30 13:45:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:45:39 [DEBUG   ] Got command RPT from MCS: ref #322027
2018-10-30 13:45:39 [DEBUG   ] summary = ERROR
2018-10-30 13:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322027  13 58421 49539845 A  ERRORERROR'
2018-10-30 13:45:39 [DEBUG   ] Got command RPT from MCS: ref #322028
2018-10-30 13:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322028  77 58421 49539846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:45:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:46:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:46:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:46:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:46:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:46:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:46:06 [DEBUG   ] Finished updating board flags in 1.131 seconds
2018-10-30 13:46:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:46:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:47:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:47:06 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-10-30 13:47:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:47:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:48:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 13:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:48:06 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-30 13:48:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:48:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:49:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 13:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:49:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:49:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:49:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:49:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:49:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:49:07 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-30 13:49:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 13:49:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 13:50:00 [DEBUG   ] Got command TBN from MCS: ref #322048
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-30 13:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   322048   8 58421 49800525 A  ERROR'
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540907402']
2018-10-30 13:50:00 [DEBUG   ] spawn_process: at 2018-10-30 13:50:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540907402']
2018-10-30 13:50:00 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-30 13:50:02 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-30 13:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 13:50:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:50:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:50:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:50:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:50:07 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-10-30 13:50:14 [DEBUG   ] Got command RPT from MCS: ref #322049
2018-10-30 13:50:14 [DEBUG   ] summary = ERROR
2018-10-30 13:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322049  13 58421 49814197 A  ERRORERROR'
2018-10-30 13:50:14 [DEBUG   ] Got command RPT from MCS: ref #322050
2018-10-30 13:50:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322050  77 58421 49814401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:50:14 [DEBUG   ] Got command RPT from MCS: ref #322051
2018-10-30 13:50:14 [DEBUG   ] summary = ERROR
2018-10-30 13:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322051  13 58421 49814605 A  ERRORERROR'
2018-10-30 13:50:14 [DEBUG   ] Got command RPT from MCS: ref #322052
2018-10-30 13:50:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322052  77 58421 49814797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:50:15 [DEBUG   ] Got command RPT from MCS: ref #322053
2018-10-30 13:50:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322053  12 58421 49815001 A  ERRORB'
2018-10-30 13:50:22 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2018-10-30 13:50:39 [DEBUG   ] Got command RPT from MCS: ref #322054
2018-10-30 13:50:39 [DEBUG   ] summary = ERROR
2018-10-30 13:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322054  13 58421 49839841 A  ERRORERROR'
2018-10-30 13:50:39 [DEBUG   ] Got command RPT from MCS: ref #322055
2018-10-30 13:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322055  77 58421 49839842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:50:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 13:51:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 13:51:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:51:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:51:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:51:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:51:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:51:07 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-10-30 13:51:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 13:51:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 13:52:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 13:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:52:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 13:52:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:52:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:52:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:52:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:52:07 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-10-30 13:52:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 13:52:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 13:53:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 13:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:53:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:53:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:53:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:53:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:53:07 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-30 13:53:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 13:53:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 13:54:03 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2018-10-30 13:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:54:07 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-30 13:54:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:54:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 13:55:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 13:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:55:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:55:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:55:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:55:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:55:07 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-30 13:55:14 [DEBUG   ] Got command RPT from MCS: ref #322088
2018-10-30 13:55:14 [DEBUG   ] summary = ERROR
2018-10-30 13:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322088  13 58421 50114285 A  ERRORERROR'
2018-10-30 13:55:14 [DEBUG   ] Got command RPT from MCS: ref #322089
2018-10-30 13:55:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322089  77 58421 50114489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:55:14 [DEBUG   ] Got command RPT from MCS: ref #322090
2018-10-30 13:55:14 [DEBUG   ] summary = ERROR
2018-10-30 13:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322090  13 58421 50114681 A  ERRORERROR'
2018-10-30 13:55:14 [DEBUG   ] Got command RPT from MCS: ref #322092
2018-10-30 13:55:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322092  77 58421 50114885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:55:15 [DEBUG   ] Got command RPT from MCS: ref #322093
2018-10-30 13:55:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 13:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322093  12 58421 50115086 A  ERRORB'
2018-10-30 13:55:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 13:55:39 [DEBUG   ] Got command RPT from MCS: ref #322098
2018-10-30 13:55:39 [DEBUG   ] summary = ERROR
2018-10-30 13:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322098  13 58421 50139849 A  ERRORERROR'
2018-10-30 13:55:39 [DEBUG   ] Got command RPT from MCS: ref #322099
2018-10-30 13:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 13:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322099  77 58421 50139850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 13:55:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 13:56:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 13:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 13:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:56:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:56:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:56:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:56:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:56:07 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-30 13:56:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 13:56:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 13:57:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 13:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:57:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:57:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:57:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:57:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:57:07 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-30 13:57:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 13:57:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 13:58:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 13:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:58:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:58:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:58:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:58:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:58:07 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-30 13:58:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 13:58:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 13:59:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 13:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 13:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 13:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 13:59:07 [DEBUG   ] Finished updating board flags in 1.317 seconds
2018-10-30 13:59:24 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-30 13:59:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 14:00:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 14:00:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:00:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:00:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:00:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:00:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:00:08 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-10-30 14:00:14 [DEBUG   ] Got command RPT from MCS: ref #322124
2018-10-30 14:00:14 [DEBUG   ] summary = ERROR
2018-10-30 14:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322124  13 58421 50414369 A  ERRORERROR'
2018-10-30 14:00:14 [DEBUG   ] Got command RPT from MCS: ref #322125
2018-10-30 14:00:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322125  77 58421 50414573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:00:14 [DEBUG   ] Got command RPT from MCS: ref #322126
2018-10-30 14:00:14 [DEBUG   ] summary = ERROR
2018-10-30 14:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322126  13 58421 50414777 A  ERRORERROR'
2018-10-30 14:00:14 [DEBUG   ] Got command RPT from MCS: ref #322127
2018-10-30 14:00:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322127  77 58421 50414982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:00:15 [DEBUG   ] Got command RPT from MCS: ref #322128
2018-10-30 14:00:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322128  12 58421 50415173 A  ERRORB'
2018-10-30 14:00:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 14:00:39 [DEBUG   ] Got command RPT from MCS: ref #322133
2018-10-30 14:00:39 [DEBUG   ] summary = ERROR
2018-10-30 14:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322133  13 58421 50439849 A  ERRORERROR'
2018-10-30 14:00:39 [DEBUG   ] Got command RPT from MCS: ref #322134
2018-10-30 14:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322134  77 58421 50439850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:00:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:01:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 14:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:01:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:01:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:01:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:01:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:01:08 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-30 14:01:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 14:01:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 14:02:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:02:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:02:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:02:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:02:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:02:08 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-30 14:02:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:02:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:03:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 14:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 14:03:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:03:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:03:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:03:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:03:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:03:08 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-30 14:03:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:03:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:04:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 14:04:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:04:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:04:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:04:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:04:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:04:08 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-10-30 14:04:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 14:04:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 14:05:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 14:05:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:05:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:05:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:05:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:05:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:05:08 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-30 14:05:14 [DEBUG   ] Got command RPT from MCS: ref #322156
2018-10-30 14:05:14 [DEBUG   ] summary = ERROR
2018-10-30 14:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322156  13 58421 50714461 A  ERRORERROR'
2018-10-30 14:05:14 [DEBUG   ] Got command RPT from MCS: ref #322157
2018-10-30 14:05:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322157  77 58421 50714653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:05:14 [DEBUG   ] Got command RPT from MCS: ref #322158
2018-10-30 14:05:14 [DEBUG   ] summary = ERROR
2018-10-30 14:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322158  13 58421 50714857 A  ERRORERROR'
2018-10-30 14:05:15 [DEBUG   ] Got command RPT from MCS: ref #322160
2018-10-30 14:05:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322160  77 58421 50715061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:05:15 [DEBUG   ] Got command RPT from MCS: ref #322161
2018-10-30 14:05:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322161  12 58421 50715265 A  ERRORB'
2018-10-30 14:05:25 [DEBUG   ] Finished updating ant stats in 1.088 seconds
2018-10-30 14:05:39 [DEBUG   ] Got command RPT from MCS: ref #322166
2018-10-30 14:05:39 [DEBUG   ] summary = ERROR
2018-10-30 14:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322166  13 58421 50739845 A  ERRORERROR'
2018-10-30 14:05:39 [DEBUG   ] Got command RPT from MCS: ref #322167
2018-10-30 14:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322167  77 58421 50739846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:05:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:06:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:06:08 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-30 14:06:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 14:06:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 14:07:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:07:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:07:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:07:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:07:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:07:08 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-30 14:07:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:07:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 14:08:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 14:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:08:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:08:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:08:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:08:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:08:08 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-30 14:08:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 14:08:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 14:09:06 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-30 14:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:09:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:09:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:09:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:09:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:09:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:09:08 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-30 14:09:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:09:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:10:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 14:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 14:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:10:08 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-30 14:10:14 [DEBUG   ] Got command RPT from MCS: ref #322191
2018-10-30 14:10:14 [DEBUG   ] summary = ERROR
2018-10-30 14:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322191  13 58421 51014541 A  ERRORERROR'
2018-10-30 14:10:14 [DEBUG   ] Got command RPT from MCS: ref #322192
2018-10-30 14:10:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322192  77 58421 51014746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:10:14 [DEBUG   ] Got command RPT from MCS: ref #322193
2018-10-30 14:10:14 [DEBUG   ] summary = ERROR
2018-10-30 14:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322193  13 58421 51014949 A  ERRORERROR'
2018-10-30 14:10:15 [DEBUG   ] Got command RPT from MCS: ref #322194
2018-10-30 14:10:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322194  77 58421 51015141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:10:15 [DEBUG   ] Got command RPT from MCS: ref #322195
2018-10-30 14:10:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322195  12 58421 51015345 A  ERRORB'
2018-10-30 14:10:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 14:10:39 [DEBUG   ] Got command RPT from MCS: ref #322196
2018-10-30 14:10:39 [DEBUG   ] summary = ERROR
2018-10-30 14:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322196  13 58421 51039850 A  ERRORERROR'
2018-10-30 14:10:39 [DEBUG   ] Got command RPT from MCS: ref #322197
2018-10-30 14:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322197  77 58421 51039850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:10:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:11:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:11:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:11:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:11:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:11:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:11:09 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-30 14:11:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:11:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 14:12:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 14:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:12:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:12:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:12:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:12:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:12:09 [DEBUG   ] Finished updating board flags in 2.160 seconds
2018-10-30 14:12:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 14:12:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 14:13:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 14:13:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 14:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 14:13:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:13:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:13:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:13:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:13:09 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-30 14:13:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 14:13:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 14:14:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 14:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:14:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:14:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:14:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:14:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:14:09 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-10-30 14:14:27 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 14:14:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 14:15:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 14:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:15:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:15:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:15:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:15:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:15:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:15:09 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-30 14:15:14 [DEBUG   ] Got command RPT from MCS: ref #322219
2018-10-30 14:15:14 [DEBUG   ] summary = ERROR
2018-10-30 14:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322219  13 58421 51314637 A  ERRORERROR'
2018-10-30 14:15:14 [DEBUG   ] Got command RPT from MCS: ref #322220
2018-10-30 14:15:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322220  77 58421 51314829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:15:15 [DEBUG   ] Got command RPT from MCS: ref #322221
2018-10-30 14:15:15 [DEBUG   ] summary = ERROR
2018-10-30 14:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322221  13 58421 51315033 A  ERRORERROR'
2018-10-30 14:15:15 [DEBUG   ] Got command RPT from MCS: ref #322223
2018-10-30 14:15:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322223  77 58421 51315237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:15:15 [DEBUG   ] Got command RPT from MCS: ref #322224
2018-10-30 14:15:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322224  12 58421 51315429 A  ERRORB'
2018-10-30 14:15:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:15:39 [DEBUG   ] Got command RPT from MCS: ref #322233
2018-10-30 14:15:39 [DEBUG   ] summary = ERROR
2018-10-30 14:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322233  13 58421 51339849 A  ERRORERROR'
2018-10-30 14:15:39 [DEBUG   ] Got command RPT from MCS: ref #322234
2018-10-30 14:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322234  77 58421 51339850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:15:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:16:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:16:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:16:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:16:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:16:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:16:09 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-10-30 14:16:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 14:16:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:17:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:17:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:17:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:17:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:17:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:17:09 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-30 14:17:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:17:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 14:18:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 14:18:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:18:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:18:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:18:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:18:09 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-30 14:18:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 14:18:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 14:19:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 14:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:19:09 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-30 14:19:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 14:19:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 14:20:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 14:20:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:20:09 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-30 14:20:14 [DEBUG   ] Got command RPT from MCS: ref #322254
2018-10-30 14:20:14 [DEBUG   ] summary = ERROR
2018-10-30 14:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322254  13 58421 51614717 A  ERRORERROR'
2018-10-30 14:20:14 [DEBUG   ] Got command RPT from MCS: ref #322255
2018-10-30 14:20:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322255  77 58421 51614921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:20:15 [DEBUG   ] Got command RPT from MCS: ref #322256
2018-10-30 14:20:15 [DEBUG   ] summary = ERROR
2018-10-30 14:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322256  13 58421 51615125 A  ERRORERROR'
2018-10-30 14:20:15 [DEBUG   ] Got command RPT from MCS: ref #322257
2018-10-30 14:20:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322257  77 58421 51615317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:20:15 [DEBUG   ] Got command RPT from MCS: ref #322258
2018-10-30 14:20:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322258  12 58421 51615521 A  ERRORB'
2018-10-30 14:20:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 14:20:39 [DEBUG   ] Got command RPT from MCS: ref #322259
2018-10-30 14:20:39 [DEBUG   ] summary = ERROR
2018-10-30 14:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322259  13 58421 51639845 A  ERRORERROR'
2018-10-30 14:20:39 [DEBUG   ] Got command RPT from MCS: ref #322260
2018-10-30 14:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322260  77 58421 51639846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:20:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 14:21:08 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2018-10-30 14:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 14:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:21:09 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-30 14:21:28 [DEBUG   ] Finished updating ant stats in 1.167 seconds
2018-10-30 14:21:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:22:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 14:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:22:09 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-10-30 14:22:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:22:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 14:23:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:23:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:23:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:23:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:23:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:23:10 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-10-30 14:23:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:23:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:24:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 14:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:24:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:24:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:24:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:24:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:24:10 [DEBUG   ] Finished updating board flags in 2.312 seconds
2018-10-30 14:24:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:24:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 14:25:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 14:25:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:25:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:25:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:25:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:25:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:25:10 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-10-30 14:25:14 [DEBUG   ] Got command RPT from MCS: ref #322286
2018-10-30 14:25:14 [DEBUG   ] summary = ERROR
2018-10-30 14:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322286  13 58421 51914805 A  ERRORERROR'
2018-10-30 14:25:15 [DEBUG   ] Got command RPT from MCS: ref #322287
2018-10-30 14:25:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322287  77 58421 51915009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:25:15 [DEBUG   ] Got command RPT from MCS: ref #322288
2018-10-30 14:25:15 [DEBUG   ] summary = ERROR
2018-10-30 14:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322288  13 58421 51915201 A  ERRORERROR'
2018-10-30 14:25:15 [DEBUG   ] Got command RPT from MCS: ref #322290
2018-10-30 14:25:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322290  77 58421 51915405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:25:15 [DEBUG   ] Got command RPT from MCS: ref #322291
2018-10-30 14:25:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322291  12 58421 51915609 A  ERRORB'
2018-10-30 14:25:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 14:25:39 [DEBUG   ] Got command RPT from MCS: ref #322296
2018-10-30 14:25:39 [DEBUG   ] summary = ERROR
2018-10-30 14:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322296  13 58421 51939849 A  ERRORERROR'
2018-10-30 14:25:39 [DEBUG   ] Got command RPT from MCS: ref #322297
2018-10-30 14:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322297  77 58421 51939850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:25:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 14:26:09 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 14:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:26:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:26:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:26:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:26:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:26:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:26:10 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-10-30 14:26:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 14:26:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 14:27:09 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2018-10-30 14:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:27:10 [DEBUG   ] Finished updating board flags in 1.667 seconds
2018-10-30 14:27:29 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2018-10-30 14:27:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 14:28:09 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-10-30 14:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:28:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 14:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:28:10 [DEBUG   ] Finished updating board flags in 1.710 seconds
2018-10-30 14:28:29 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-10-30 14:28:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 14:29:09 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2018-10-30 14:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:29:10 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-30 14:29:29 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-10-30 14:29:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 14:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 14:30:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 14:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:30:10 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-30 14:30:14 [DEBUG   ] Got command RPT from MCS: ref #322317
2018-10-30 14:30:14 [DEBUG   ] summary = ERROR
2018-10-30 14:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322317  13 58421 52214889 A  ERRORERROR'
2018-10-30 14:30:15 [DEBUG   ] Got command RPT from MCS: ref #322318
2018-10-30 14:30:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322318  77 58421 52215093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:30:15 [DEBUG   ] Got command RPT from MCS: ref #322319
2018-10-30 14:30:15 [DEBUG   ] summary = ERROR
2018-10-30 14:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322319  13 58421 52215285 A  ERRORERROR'
2018-10-30 14:30:15 [DEBUG   ] Got command RPT from MCS: ref #322320
2018-10-30 14:30:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322320  77 58421 52215489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:30:15 [DEBUG   ] Got command RPT from MCS: ref #322321
2018-10-30 14:30:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322321  12 58421 52215693 A  ERRORB'
2018-10-30 14:30:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 14:30:39 [DEBUG   ] Got command RPT from MCS: ref #322326
2018-10-30 14:30:39 [DEBUG   ] summary = ERROR
2018-10-30 14:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322326  13 58421 52239853 A  ERRORERROR'
2018-10-30 14:30:39 [DEBUG   ] Got command RPT from MCS: ref #322327
2018-10-30 14:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322327  77 58421 52239854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:30:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 14:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:31:10 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-10-30 14:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:31:10 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-30 14:31:30 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-10-30 14:31:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:32:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:32:10 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-10-30 14:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:32:10 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-10-30 14:32:30 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-10-30 14:32:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 14:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:33:10 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-10-30 14:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:33:10 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-30 14:33:30 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-30 14:33:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 14:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:34:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:34:10 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-30 14:34:11 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-30 14:34:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 14:34:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 14:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 14:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 14:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:35:10 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-10-30 14:35:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:35:14 [DEBUG   ] Got command RPT from MCS: ref #322349
2018-10-30 14:35:14 [DEBUG   ] summary = ERROR
2018-10-30 14:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322349  13 58421 52514981 A  ERRORERROR'
2018-10-30 14:35:15 [DEBUG   ] Got command RPT from MCS: ref #322350
2018-10-30 14:35:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322350  77 58421 52515173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:35:15 [DEBUG   ] Got command RPT from MCS: ref #322351
2018-10-30 14:35:15 [DEBUG   ] summary = ERROR
2018-10-30 14:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322351  13 58421 52515377 A  ERRORERROR'
2018-10-30 14:35:15 [DEBUG   ] Got command RPT from MCS: ref #322353
2018-10-30 14:35:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322353  77 58421 52515581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:35:15 [DEBUG   ] Got command RPT from MCS: ref #322354
2018-10-30 14:35:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322354  12 58421 52515773 A  ERRORB'
2018-10-30 14:35:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:35:39 [DEBUG   ] Got command RPT from MCS: ref #322359
2018-10-30 14:35:39 [DEBUG   ] summary = ERROR
2018-10-30 14:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322359  13 58421 52539857 A  ERRORERROR'
2018-10-30 14:35:39 [DEBUG   ] Got command RPT from MCS: ref #322360
2018-10-30 14:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322360  77 58421 52539858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:35:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 14:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:36:11 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2018-10-30 14:36:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:36:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:36:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:36:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:36:11 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-10-30 14:36:31 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-10-30 14:36:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:37:11 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-10-30 14:37:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:37:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:37:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:37:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:37:11 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-10-30 14:37:31 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2018-10-30 14:37:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:38:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:38:11 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-10-30 14:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:38:11 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-30 14:38:31 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-30 14:38:51 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 14:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:39:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:39:11 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-30 14:39:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 14:39:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 14:39:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 14:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:40:11 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-30 14:40:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:40:15 [DEBUG   ] Got command RPT from MCS: ref #322384
2018-10-30 14:40:15 [DEBUG   ] summary = ERROR
2018-10-30 14:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322384  13 58421 52815061 A  ERRORERROR'
2018-10-30 14:40:15 [DEBUG   ] Got command RPT from MCS: ref #322385
2018-10-30 14:40:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322385  77 58421 52815265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:40:15 [DEBUG   ] Got command RPT from MCS: ref #322386
2018-10-30 14:40:15 [DEBUG   ] summary = ERROR
2018-10-30 14:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322386  13 58421 52815457 A  ERRORERROR'
2018-10-30 14:40:15 [DEBUG   ] Got command RPT from MCS: ref #322387
2018-10-30 14:40:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322387  77 58421 52815661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:40:15 [DEBUG   ] Got command RPT from MCS: ref #322388
2018-10-30 14:40:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322388  12 58421 52815865 A  ERRORB'
2018-10-30 14:40:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:40:39 [DEBUG   ] Got command RPT from MCS: ref #322389
2018-10-30 14:40:39 [DEBUG   ] summary = ERROR
2018-10-30 14:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322389  13 58421 52839857 A  ERRORERROR'
2018-10-30 14:40:39 [DEBUG   ] Got command RPT from MCS: ref #322390
2018-10-30 14:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322390  77 58421 52839858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:40:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 14:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:41:11 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-30 14:41:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:41:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:41:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:42:11 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-10-30 14:42:12 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-30 14:42:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 14:42:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 14:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:43:11 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-10-30 14:43:13 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 14:43:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 14:43:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 14:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:44:11 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-30 14:44:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 14:44:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 14:44:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 14:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 14:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:45:11 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-30 14:45:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:45:15 [DEBUG   ] Got command RPT from MCS: ref #322412
2018-10-30 14:45:15 [DEBUG   ] summary = ERROR
2018-10-30 14:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322412  13 58421 53115149 A  ERRORERROR'
2018-10-30 14:45:15 [DEBUG   ] Got command RPT from MCS: ref #322413
2018-10-30 14:45:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322413  77 58421 53115353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:45:15 [DEBUG   ] Got command RPT from MCS: ref #322414
2018-10-30 14:45:15 [DEBUG   ] summary = ERROR
2018-10-30 14:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322414  13 58421 53115545 A  ERRORERROR'
2018-10-30 14:45:15 [DEBUG   ] Got command RPT from MCS: ref #322416
2018-10-30 14:45:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322416  77 58421 53115749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:45:15 [DEBUG   ] Got command RPT from MCS: ref #322418
2018-10-30 14:45:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322418  12 58421 53115953 A  ERRORB'
2018-10-30 14:45:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:45:39 [DEBUG   ] Got command RPT from MCS: ref #322426
2018-10-30 14:45:39 [DEBUG   ] summary = ERROR
2018-10-30 14:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322426  13 58421 53139849 A  ERRORERROR'
2018-10-30 14:45:39 [DEBUG   ] Got command RPT from MCS: ref #322427
2018-10-30 14:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322427  77 58421 53139850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:45:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 14:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:46:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:46:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:46:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:46:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:46:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:46:12 [DEBUG   ] Finished updating board flags in 2.099 seconds
2018-10-30 14:46:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:46:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:46:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:47:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:47:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:47:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:47:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:47:12 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-30 14:47:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:47:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:47:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 14:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 14:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:48:12 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-30 14:48:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:48:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:48:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 14:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:49:12 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-10-30 14:49:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 14:49:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:49:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 14:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:50:12 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-10-30 14:50:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 14:50:15 [DEBUG   ] Got command RPT from MCS: ref #322447
2018-10-30 14:50:15 [DEBUG   ] summary = ERROR
2018-10-30 14:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322447  13 58421 53415237 A  ERRORERROR'
2018-10-30 14:50:15 [DEBUG   ] Got command RPT from MCS: ref #322448
2018-10-30 14:50:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322448  77 58421 53415429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:50:15 [DEBUG   ] Got command RPT from MCS: ref #322449
2018-10-30 14:50:15 [DEBUG   ] summary = ERROR
2018-10-30 14:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322449  13 58421 53415633 A  ERRORERROR'
2018-10-30 14:50:15 [DEBUG   ] Got command RPT from MCS: ref #322450
2018-10-30 14:50:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322450  77 58421 53415837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:50:16 [DEBUG   ] Got command RPT from MCS: ref #322451
2018-10-30 14:50:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322451  12 58421 53416041 A  ERRORB'
2018-10-30 14:50:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:50:39 [DEBUG   ] Got command RPT from MCS: ref #322452
2018-10-30 14:50:39 [DEBUG   ] summary = ERROR
2018-10-30 14:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322452  13 58421 53439853 A  ERRORERROR'
2018-10-30 14:50:39 [DEBUG   ] Got command RPT from MCS: ref #322453
2018-10-30 14:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322453  77 58421 53439854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:50:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:51:12 [DEBUG   ] Finished updating board flags in 1.726 seconds
2018-10-30 14:51:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:51:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:51:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 14:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:52:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:52:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:52:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:52:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:52:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:52:13 [DEBUG   ] Finished updating board flags in 2.320 seconds
2018-10-30 14:52:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 14:52:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 14:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:53:12 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-30 14:53:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 14:53:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 14:53:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 14:54:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 14:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 14:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:54:12 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-30 14:54:13 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-30 14:54:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 14:54:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 14:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:55:12 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-30 14:55:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 14:55:15 [DEBUG   ] Got command RPT from MCS: ref #322479
2018-10-30 14:55:15 [DEBUG   ] summary = ERROR
2018-10-30 14:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322479  13 58421 53715314 A  ERRORERROR'
2018-10-30 14:55:15 [DEBUG   ] Got command RPT from MCS: ref #322480
2018-10-30 14:55:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322480  77 58421 53715517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:55:15 [DEBUG   ] Got command RPT from MCS: ref #322481
2018-10-30 14:55:15 [DEBUG   ] summary = ERROR
2018-10-30 14:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322481  13 58421 53715722 A  ERRORERROR'
2018-10-30 14:55:15 [DEBUG   ] Got command RPT from MCS: ref #322483
2018-10-30 14:55:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322483  77 58421 53715925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:55:16 [DEBUG   ] Got command RPT from MCS: ref #322484
2018-10-30 14:55:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 14:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322484  12 58421 53716118 A  ERRORB'
2018-10-30 14:55:34 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 14:55:39 [DEBUG   ] Got command RPT from MCS: ref #322489
2018-10-30 14:55:39 [DEBUG   ] summary = ERROR
2018-10-30 14:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322489  13 58421 53739853 A  ERRORERROR'
2018-10-30 14:55:39 [DEBUG   ] Got command RPT from MCS: ref #322490
2018-10-30 14:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 14:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322490  77 58421 53739854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 14:55:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 14:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:56:12 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-30 14:56:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 14:56:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 14:56:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:57:12 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-30 14:57:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 14:57:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 14:57:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 14:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 14:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:58:12 [DEBUG   ] Finished updating board flags in 1.512 seconds
2018-10-30 14:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:58:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 14:58:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 14:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 14:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 14:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 14:59:13 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-30 14:59:14 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-10-30 14:59:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 14:59:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 15:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 15:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:00:13 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-10-30 15:00:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:00:15 [DEBUG   ] Got command RPT from MCS: ref #322510
2018-10-30 15:00:15 [DEBUG   ] summary = ERROR
2018-10-30 15:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322510  13 58421 54015401 A  ERRORERROR'
2018-10-30 15:00:15 [DEBUG   ] Got command RPT from MCS: ref #322511
2018-10-30 15:00:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322511  77 58421 54015605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:00:15 [DEBUG   ] Got command RPT from MCS: ref #322512
2018-10-30 15:00:15 [DEBUG   ] summary = ERROR
2018-10-30 15:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322512  13 58421 54015809 A  ERRORERROR'
2018-10-30 15:00:16 [DEBUG   ] Got command RPT from MCS: ref #322513
2018-10-30 15:00:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322513  77 58421 54016013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:00:16 [DEBUG   ] Got command RPT from MCS: ref #322514
2018-10-30 15:00:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322514  12 58421 54016205 A  ERRORB'
2018-10-30 15:00:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 15:00:39 [DEBUG   ] Got command RPT from MCS: ref #322519
2018-10-30 15:00:39 [DEBUG   ] summary = ERROR
2018-10-30 15:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322519  13 58421 54039861 A  ERRORERROR'
2018-10-30 15:00:39 [DEBUG   ] Got command RPT from MCS: ref #322520
2018-10-30 15:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322520  77 58421 54039862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:00:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 15:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:01:13 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-30 15:01:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 15:01:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 15:01:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:02:13 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-30 15:02:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:02:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 15:02:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:03:13 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-30 15:03:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:03:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 15:03:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 15:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:04:13 [DEBUG   ] Finished updating board flags in 1.843 seconds
2018-10-30 15:04:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 15:04:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:04:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 15:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:05:13 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-10-30 15:05:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 15:05:15 [DEBUG   ] Got command RPT from MCS: ref #322542
2018-10-30 15:05:15 [DEBUG   ] summary = ERROR
2018-10-30 15:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322542  13 58421 54315485 A  ERRORERROR'
2018-10-30 15:05:15 [DEBUG   ] Got command RPT from MCS: ref #322543
2018-10-30 15:05:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322543  77 58421 54315689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:05:15 [DEBUG   ] Got command RPT from MCS: ref #322544
2018-10-30 15:05:15 [DEBUG   ] summary = ERROR
2018-10-30 15:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322544  13 58421 54315893 A  ERRORERROR'
2018-10-30 15:05:16 [DEBUG   ] Got command RPT from MCS: ref #322546
2018-10-30 15:05:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322546  77 58421 54316097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:05:16 [DEBUG   ] Got command RPT from MCS: ref #322547
2018-10-30 15:05:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322547  12 58421 54316289 A  ERRORB'
2018-10-30 15:05:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:05:39 [DEBUG   ] Got command RPT from MCS: ref #322552
2018-10-30 15:05:39 [DEBUG   ] summary = ERROR
2018-10-30 15:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322552  13 58421 54339853 A  ERRORERROR'
2018-10-30 15:05:39 [DEBUG   ] Got command RPT from MCS: ref #322553
2018-10-30 15:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322553  77 58421 54339854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:05:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:06:13 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-30 15:06:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:06:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 15:06:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 15:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:07:13 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-30 15:07:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 15:07:36 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2018-10-30 15:07:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:08:13 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-30 15:08:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:08:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:08:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:09:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:09:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 15:09:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:09:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:09:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:09:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:09:13 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-30 15:09:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:09:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:09:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:10:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:10:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:10:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:10:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:10:13 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-30 15:10:15 [DEBUG   ] Got command RPT from MCS: ref #322577
2018-10-30 15:10:15 [DEBUG   ] summary = ERROR
2018-10-30 15:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322577  13 58421 54615574 A  ERRORERROR'
2018-10-30 15:10:15 [DEBUG   ] Got command RPT from MCS: ref #322578
2018-10-30 15:10:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322578  77 58421 54615777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:10:15 [DEBUG   ] Got command RPT from MCS: ref #322579
2018-10-30 15:10:15 [DEBUG   ] summary = ERROR
2018-10-30 15:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322579  13 58421 54615981 A  ERRORERROR'
2018-10-30 15:10:16 [DEBUG   ] Got command RPT from MCS: ref #322580
2018-10-30 15:10:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322580  77 58421 54616185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:10:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 15:10:16 [DEBUG   ] Got command RPT from MCS: ref #322581
2018-10-30 15:10:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322581  12 58421 54616378 A  ERRORB'
2018-10-30 15:10:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:10:39 [DEBUG   ] Got command RPT from MCS: ref #322582
2018-10-30 15:10:39 [DEBUG   ] summary = ERROR
2018-10-30 15:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322582  13 58421 54639865 A  ERRORERROR'
2018-10-30 15:10:39 [DEBUG   ] Got command RPT from MCS: ref #322583
2018-10-30 15:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322583  77 58421 54639866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:10:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:11:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:11:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:11:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:11:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:11:13 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-10-30 15:11:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 15:11:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:11:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:12:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:12:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:12:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:12:13 [WARNING ] (13, 1, 'bot')
2018-10-30 15:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:12:13 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-10-30 15:12:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:12:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 15:12:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:13:14 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-10-30 15:13:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:13:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:13:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 15:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:14:14 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-10-30 15:14:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 15:14:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:14:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:15:14 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-30 15:15:15 [DEBUG   ] Got command RPT from MCS: ref #322605
2018-10-30 15:15:15 [DEBUG   ] summary = ERROR
2018-10-30 15:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322605  13 58421 54915661 A  ERRORERROR'
2018-10-30 15:15:15 [DEBUG   ] Got command RPT from MCS: ref #322606
2018-10-30 15:15:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322606  77 58421 54915865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:15:16 [DEBUG   ] Got command RPT from MCS: ref #322607
2018-10-30 15:15:16 [DEBUG   ] summary = ERROR
2018-10-30 15:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322607  13 58421 54916069 A  ERRORERROR'
2018-10-30 15:15:16 [DEBUG   ] Got command RPT from MCS: ref #322609
2018-10-30 15:15:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322609  77 58421 54916261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:15:16 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-10-30 15:15:16 [DEBUG   ] Got command RPT from MCS: ref #322610
2018-10-30 15:15:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322610  12 58421 54916465 A  ERRORB'
2018-10-30 15:15:36 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 15:15:39 [DEBUG   ] Got command RPT from MCS: ref #322619
2018-10-30 15:15:39 [DEBUG   ] summary = ERROR
2018-10-30 15:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322619  13 58421 54939865 A  ERRORERROR'
2018-10-30 15:15:39 [DEBUG   ] Got command RPT from MCS: ref #322620
2018-10-30 15:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322620  77 58421 54939866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:15:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:16:14 [DEBUG   ] Finished updating board flags in 1.926 seconds
2018-10-30 15:16:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:16:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 15:16:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 15:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:17:14 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-30 15:17:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:17:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:17:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:18:14 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-30 15:18:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:18:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:18:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:19:14 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-30 15:19:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:19:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:19:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:20:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 15:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:20:14 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-30 15:20:15 [DEBUG   ] Got command RPT from MCS: ref #322640
2018-10-30 15:20:15 [DEBUG   ] summary = ERROR
2018-10-30 15:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322640  13 58421 55215753 A  ERRORERROR'
2018-10-30 15:20:15 [DEBUG   ] Got command RPT from MCS: ref #322641
2018-10-30 15:20:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322641  77 58421 55215945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:20:16 [DEBUG   ] Got command RPT from MCS: ref #322642
2018-10-30 15:20:16 [DEBUG   ] summary = ERROR
2018-10-30 15:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322642  13 58421 55216149 A  ERRORERROR'
2018-10-30 15:20:16 [DEBUG   ] Got command RPT from MCS: ref #322643
2018-10-30 15:20:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322643  77 58421 55216354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:20:16 [DEBUG   ] Got command RPT from MCS: ref #322644
2018-10-30 15:20:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322644  12 58421 55216557 A  ERRORB'
2018-10-30 15:20:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:20:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:20:39 [DEBUG   ] Got command RPT from MCS: ref #322645
2018-10-30 15:20:39 [DEBUG   ] summary = ERROR
2018-10-30 15:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322645  13 58421 55239865 A  ERRORERROR'
2018-10-30 15:20:39 [DEBUG   ] Got command RPT from MCS: ref #322646
2018-10-30 15:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322646  77 58421 55239866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:20:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 15:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:21:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:21:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:21:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:21:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:21:14 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-30 15:21:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:21:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:21:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:22:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:22:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:22:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:22:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:22:14 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-30 15:22:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 15:22:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:22:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-30 15:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:23:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 15:23:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:23:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:23:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:23:14 [WARNING ] (13, 1, 'bot')
2018-10-30 15:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:23:14 [DEBUG   ] Finished updating board flags in 1.321 seconds
2018-10-30 15:23:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 15:23:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:23:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 15:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:24:15 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-10-30 15:24:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:24:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 15:24:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 15:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:25:15 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-30 15:25:15 [DEBUG   ] Got command RPT from MCS: ref #322672
2018-10-30 15:25:15 [DEBUG   ] summary = ERROR
2018-10-30 15:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322672  13 58421 55515837 A  ERRORERROR'
2018-10-30 15:25:16 [DEBUG   ] Got command RPT from MCS: ref #322673
2018-10-30 15:25:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322673  77 58421 55516029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:25:16 [DEBUG   ] Got command RPT from MCS: ref #322674
2018-10-30 15:25:16 [DEBUG   ] summary = ERROR
2018-10-30 15:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322674  13 58421 55516233 A  ERRORERROR'
2018-10-30 15:25:16 [DEBUG   ] Got command RPT from MCS: ref #322676
2018-10-30 15:25:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322676  77 58421 55516437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:25:16 [DEBUG   ] Got command RPT from MCS: ref #322677
2018-10-30 15:25:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322677  12 58421 55516641 A  ERRORB'
2018-10-30 15:25:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 15:25:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 15:25:39 [DEBUG   ] Got command RPT from MCS: ref #322682
2018-10-30 15:25:39 [DEBUG   ] summary = ERROR
2018-10-30 15:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322682  13 58421 55539865 A  ERRORERROR'
2018-10-30 15:25:39 [DEBUG   ] Got command RPT from MCS: ref #322683
2018-10-30 15:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322683  77 58421 55539866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:25:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 15:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:26:15 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-30 15:26:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 15:26:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:26:58 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-30 15:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:27:15 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-30 15:27:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:27:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:27:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:28:15 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-30 15:28:18 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-10-30 15:28:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:28:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:29:15 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-30 15:29:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 15:29:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-30 15:29:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:30:15 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-30 15:30:15 [DEBUG   ] Got command RPT from MCS: ref #322703
2018-10-30 15:30:15 [DEBUG   ] summary = ERROR
2018-10-30 15:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322703  13 58421 55815917 A  ERRORERROR'
2018-10-30 15:30:16 [DEBUG   ] Got command RPT from MCS: ref #322704
2018-10-30 15:30:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322704  77 58421 55816121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:30:16 [DEBUG   ] Got command RPT from MCS: ref #322705
2018-10-30 15:30:16 [DEBUG   ] summary = ERROR
2018-10-30 15:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322705  13 58421 55816313 A  ERRORERROR'
2018-10-30 15:30:16 [DEBUG   ] Got command RPT from MCS: ref #322706
2018-10-30 15:30:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322706  77 58421 55816517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:30:16 [DEBUG   ] Got command RPT from MCS: ref #322707
2018-10-30 15:30:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322707  12 58421 55816721 A  ERRORB'
2018-10-30 15:30:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:30:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:30:39 [DEBUG   ] Got command RPT from MCS: ref #322712
2018-10-30 15:30:39 [DEBUG   ] summary = ERROR
2018-10-30 15:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322712  13 58421 55839861 A  ERRORERROR'
2018-10-30 15:30:39 [DEBUG   ] Got command RPT from MCS: ref #322713
2018-10-30 15:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322713  77 58421 55839862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:30:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-30 15:31:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:31:15 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-30 15:31:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 15:31:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 15:31:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:32:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:32:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:32:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:32:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:32:15 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-30 15:32:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:32:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:32:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:33:15 [WARNING ] (13, 1, 'bot')
2018-10-30 15:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:33:15 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-30 15:33:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 15:33:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:33:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:34:16 [DEBUG   ] Finished updating board flags in 2.068 seconds
2018-10-30 15:34:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 15:34:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 15:34:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:35:16 [DEBUG   ] Got command RPT from MCS: ref #322735
2018-10-30 15:35:16 [DEBUG   ] summary = ERROR
2018-10-30 15:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322735  13 58421 56116005 A  ERRORERROR'
2018-10-30 15:35:16 [DEBUG   ] Got command RPT from MCS: ref #322736
2018-10-30 15:35:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322736  77 58421 56116197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:35:16 [DEBUG   ] Got command RPT from MCS: ref #322737
2018-10-30 15:35:16 [DEBUG   ] summary = ERROR
2018-10-30 15:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322737  13 58421 56116401 A  ERRORERROR'
2018-10-30 15:35:16 [DEBUG   ] Got command RPT from MCS: ref #322739
2018-10-30 15:35:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322739  77 58421 56116605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:35:16 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-30 15:35:16 [DEBUG   ] Got command RPT from MCS: ref #322741
2018-10-30 15:35:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322741  12 58421 56116809 A  ERRORB'
2018-10-30 15:35:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 15:35:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 15:35:39 [DEBUG   ] Got command RPT from MCS: ref #322745
2018-10-30 15:35:39 [DEBUG   ] summary = ERROR
2018-10-30 15:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322745  13 58421 56139861 A  ERRORERROR'
2018-10-30 15:35:39 [DEBUG   ] Got command RPT from MCS: ref #322746
2018-10-30 15:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322746  77 58421 56139862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:35:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:36:16 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-10-30 15:36:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:36:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 15:36:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:37:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:37:16 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-30 15:37:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 15:37:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 15:37:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 15:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:38:16 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-30 15:38:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 15:38:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 15:38:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:39:16 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-30 15:39:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 15:39:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 15:40:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-30 15:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:40:16 [DEBUG   ] Got command RPT from MCS: ref #322770
2018-10-30 15:40:16 [DEBUG   ] summary = ERROR
2018-10-30 15:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322770  13 58421 56416086 A  ERRORERROR'
2018-10-30 15:40:16 [DEBUG   ] Got command RPT from MCS: ref #322771
2018-10-30 15:40:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322771  77 58421 56416290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:40:16 [DEBUG   ] Got command RPT from MCS: ref #322772
2018-10-30 15:40:16 [DEBUG   ] summary = ERROR
2018-10-30 15:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322772  13 58421 56416485 A  ERRORERROR'
2018-10-30 15:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:40:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:40:16 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-30 15:40:16 [DEBUG   ] Got command RPT from MCS: ref #322773
2018-10-30 15:40:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322773  77 58421 56416689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:40:16 [DEBUG   ] Got command RPT from MCS: ref #322774
2018-10-30 15:40:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322774  12 58421 56416894 A  ERRORB'
2018-10-30 15:40:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 15:40:39 [DEBUG   ] Got command RPT from MCS: ref #322775
2018-10-30 15:40:39 [DEBUG   ] summary = ERROR
2018-10-30 15:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322775  13 58421 56439865 A  ERRORERROR'
2018-10-30 15:40:39 [DEBUG   ] Got command RPT from MCS: ref #322776
2018-10-30 15:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322776  77 58421 56439866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:40:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 15:41:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:41:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 15:41:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 15:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:41:16 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-30 15:41:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:41:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:42:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:42:16 [DEBUG   ] Finished updating board flags in 1.512 seconds
2018-10-30 15:42:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:42:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 15:43:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:43:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 15:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 15:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:43:16 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-30 15:43:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 15:43:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:44:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 15:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:44:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:44:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:44:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:44:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:44:17 [DEBUG   ] Finished updating board flags in 2.283 seconds
2018-10-30 15:44:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:44:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:45:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 15:45:16 [DEBUG   ] Got command RPT from MCS: ref #322798
2018-10-30 15:45:16 [DEBUG   ] summary = ERROR
2018-10-30 15:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322798  13 58421 56716174 A  ERRORERROR'
2018-10-30 15:45:16 [DEBUG   ] Got command RPT from MCS: ref #322799
2018-10-30 15:45:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322799  77 58421 56716370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:45:16 [DEBUG   ] Got command RPT from MCS: ref #322800
2018-10-30 15:45:16 [DEBUG   ] summary = ERROR
2018-10-30 15:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322800  13 58421 56716566 A  ERRORERROR'
2018-10-30 15:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:45:16 [DEBUG   ] Got command RPT from MCS: ref #322802
2018-10-30 15:45:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322802  77 58421 56716769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:45:16 [DEBUG   ] Got command RPT from MCS: ref #322803
2018-10-30 15:45:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322803  12 58421 56716973 A  ERRORBĚÍ'
2018-10-30 15:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:45:17 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-10-30 15:45:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 15:45:39 [DEBUG   ] Got command RPT from MCS: ref #322812
2018-10-30 15:45:39 [DEBUG   ] summary = ERROR
2018-10-30 15:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322812  13 58421 56739865 A  ERRORERROR'
2018-10-30 15:45:39 [DEBUG   ] Got command RPT from MCS: ref #322813
2018-10-30 15:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322813  77 58421 56739866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:45:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:46:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:46:17 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-30 15:46:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:46:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 15:47:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:47:17 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-30 15:47:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:47:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:48:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 15:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:48:17 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-30 15:48:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 15:48:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:49:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 15:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:49:17 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-30 15:49:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:49:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:50:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 15:50:16 [DEBUG   ] Got command RPT from MCS: ref #322833
2018-10-30 15:50:16 [DEBUG   ] summary = ERROR
2018-10-30 15:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322833  13 58421 57016257 A  ERRORERROR'
2018-10-30 15:50:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:50:16 [DEBUG   ] Got command RPT from MCS: ref #322834
2018-10-30 15:50:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322834  77 58421 57016450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:50:16 [DEBUG   ] Got command RPT from MCS: ref #322835
2018-10-30 15:50:16 [DEBUG   ] summary = ERROR
2018-10-30 15:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322835  13 58421 57016654 A  ERRORERROR'
2018-10-30 15:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:50:16 [DEBUG   ] Got command RPT from MCS: ref #322836
2018-10-30 15:50:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322836  77 58421 57016857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:50:17 [DEBUG   ] Got command RPT from MCS: ref #322837
2018-10-30 15:50:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322837  12 58421 57017062 A  ERRORB'
2018-10-30 15:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:50:17 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-30 15:50:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 15:50:39 [DEBUG   ] Got command RPT from MCS: ref #322838
2018-10-30 15:50:39 [DEBUG   ] summary = ERROR
2018-10-30 15:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322838  13 58421 57039865 A  ERRORERROR'
2018-10-30 15:50:39 [DEBUG   ] Got command RPT from MCS: ref #322839
2018-10-30 15:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322839  77 58421 57039866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:50:41 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-30 15:51:01 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 15:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:51:17 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-30 15:51:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:51:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 15:52:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:52:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:52:17 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-10-30 15:52:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 15:52:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:53:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-30 15:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:53:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:53:17 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-30 15:53:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 15:53:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:54:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 15:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:54:17 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-30 15:54:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 15:54:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:55:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 15:55:16 [DEBUG   ] Got command RPT from MCS: ref #322865
2018-10-30 15:55:16 [DEBUG   ] summary = ERROR
2018-10-30 15:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322865  13 58421 57316333 A  ERRORERROR'
2018-10-30 15:55:16 [DEBUG   ] Got command RPT from MCS: ref #322866
2018-10-30 15:55:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322866  77 58421 57316541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:55:16 [DEBUG   ] Got command RPT from MCS: ref #322867
2018-10-30 15:55:16 [DEBUG   ] summary = ERROR
2018-10-30 15:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322867  13 58421 57316745 A  ERRORERROR'
2018-10-30 15:55:16 [DEBUG   ] Got command RPT from MCS: ref #322869
2018-10-30 15:55:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322869  77 58421 57316941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:55:17 [DEBUG   ] Got command RPT from MCS: ref #322870
2018-10-30 15:55:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 15:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322870  12 58421 57317137 A  ERRORBĚÍ'
2018-10-30 15:55:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 15:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:55:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:55:17 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-30 15:55:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-30 15:55:39 [DEBUG   ] Got command RPT from MCS: ref #322875
2018-10-30 15:55:39 [DEBUG   ] summary = ERROR
2018-10-30 15:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322875  13 58421 57339865 A  ERRORERROR'
2018-10-30 15:55:39 [DEBUG   ] Got command RPT from MCS: ref #322876
2018-10-30 15:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 15:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322876  77 58421 57339866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 15:55:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 15:56:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 15:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 15:56:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:56:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:56:17 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-10-30 15:56:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 15:56:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 15:57:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 15:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:57:17 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-30 15:57:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-30 15:57:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:58:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 15:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 15:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:58:17 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-30 15:58:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 15:58:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 15:59:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 15:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 15:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 15:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 15:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 15:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 15:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 15:59:18 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-10-30 15:59:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 15:59:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 16:00:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:00:16 [DEBUG   ] Got command RPT from MCS: ref #322896
2018-10-30 16:00:16 [DEBUG   ] summary = ERROR
2018-10-30 16:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322896  13 58421 57616425 A  ERRORERROR'
2018-10-30 16:00:16 [DEBUG   ] Got command RPT from MCS: ref #322897
2018-10-30 16:00:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322897  77 58421 57616629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:00:16 [DEBUG   ] Got command RPT from MCS: ref #322898
2018-10-30 16:00:16 [DEBUG   ] summary = ERROR
2018-10-30 16:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322898  13 58421 57616821 A  ERRORERROR'
2018-10-30 16:00:17 [DEBUG   ] Got command RPT from MCS: ref #322899
2018-10-30 16:00:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322899  77 58421 57617026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:00:17 [DEBUG   ] Got command RPT from MCS: ref #322900
2018-10-30 16:00:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322900  12 58421 57617229 A  ERRORBĚÍ'
2018-10-30 16:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:00:18 [DEBUG   ] Finished updating board flags in 2.132 seconds
2018-10-30 16:00:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 16:00:39 [DEBUG   ] Got command RPT from MCS: ref #322905
2018-10-30 16:00:39 [DEBUG   ] summary = ERROR
2018-10-30 16:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322905  13 58421 57639873 A  ERRORERROR'
2018-10-30 16:00:39 [DEBUG   ] Got command RPT from MCS: ref #322906
2018-10-30 16:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322906  77 58421 57639874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:00:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 16:01:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 16:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:01:18 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-10-30 16:01:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 16:01:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 16:02:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 16:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 16:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:02:18 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-10-30 16:02:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 16:02:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:03:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:03:18 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-30 16:03:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 16:03:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 16:04:02 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-30 16:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:04:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 16:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:04:18 [DEBUG   ] Finished updating board flags in 1.855 seconds
2018-10-30 16:04:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:04:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 16:05:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 16:05:16 [DEBUG   ] Got command RPT from MCS: ref #322928
2018-10-30 16:05:16 [DEBUG   ] summary = ERROR
2018-10-30 16:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322928  13 58421 57916513 A  ERRORERROR'
2018-10-30 16:05:16 [DEBUG   ] Got command RPT from MCS: ref #322929
2018-10-30 16:05:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322929  77 58421 57916705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:05:16 [DEBUG   ] Got command RPT from MCS: ref #322930
2018-10-30 16:05:16 [DEBUG   ] summary = ERROR
2018-10-30 16:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322930  13 58421 57916909 A  ERRORERROR'
2018-10-30 16:05:17 [DEBUG   ] Got command RPT from MCS: ref #322932
2018-10-30 16:05:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322932  77 58421 57917113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:05:17 [DEBUG   ] Got command RPT from MCS: ref #322933
2018-10-30 16:05:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322933  12 58421 57917318 A  ERRORBĚÍ'
2018-10-30 16:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:05:18 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-10-30 16:05:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:05:39 [DEBUG   ] Got command RPT from MCS: ref #322938
2018-10-30 16:05:39 [DEBUG   ] summary = ERROR
2018-10-30 16:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322938  13 58421 57939869 A  ERRORERROR'
2018-10-30 16:05:39 [DEBUG   ] Got command RPT from MCS: ref #322939
2018-10-30 16:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322939  77 58421 57939870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:05:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:06:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 16:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:06:18 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-30 16:06:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 16:06:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 16:07:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:07:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:07:18 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-10-30 16:07:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:07:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 16:08:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 16:08:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 16:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:08:18 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-10-30 16:08:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:08:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:09:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 16:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:09:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:09:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:09:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:09:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:09:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:09:19 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-10-30 16:09:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 16:09:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:10:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:10:16 [DEBUG   ] Got command RPT from MCS: ref #322963
2018-10-30 16:10:16 [DEBUG   ] summary = ERROR
2018-10-30 16:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322963  13 58421 58216601 A  ERRORERROR'
2018-10-30 16:10:16 [DEBUG   ] Got command RPT from MCS: ref #322964
2018-10-30 16:10:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322964  77 58421 58216805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:10:17 [DEBUG   ] Got command RPT from MCS: ref #322965
2018-10-30 16:10:17 [DEBUG   ] summary = ERROR
2018-10-30 16:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322965  13 58421 58217009 A  ERRORERROR'
2018-10-30 16:10:17 [DEBUG   ] Got command RPT from MCS: ref #322966
2018-10-30 16:10:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322966  77 58421 58217201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:10:17 [DEBUG   ] Got command RPT from MCS: ref #322967
2018-10-30 16:10:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322967  12 58421 58217405 A  ERRORB'
2018-10-30 16:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:10:19 [DEBUG   ] Finished updating board flags in 2.109 seconds
2018-10-30 16:10:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 16:10:39 [DEBUG   ] Got command RPT from MCS: ref #322968
2018-10-30 16:10:39 [DEBUG   ] summary = ERROR
2018-10-30 16:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322968  13 58421 58239873 A  ERRORERROR'
2018-10-30 16:10:39 [DEBUG   ] Got command RPT from MCS: ref #322969
2018-10-30 16:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322969  77 58421 58239874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:10:42 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-10-30 16:11:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 16:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:11:19 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-30 16:11:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:11:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:12:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:12:19 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-30 16:12:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:12:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:13:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:13:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:13:19 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-10-30 16:13:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:13:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:14:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:14:19 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-30 16:14:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:14:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:15:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:15:16 [DEBUG   ] Got command RPT from MCS: ref #322991
2018-10-30 16:15:16 [DEBUG   ] summary = ERROR
2018-10-30 16:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322991  13 58421 58516689 A  ERRORERROR'
2018-10-30 16:15:16 [DEBUG   ] Got command RPT from MCS: ref #322992
2018-10-30 16:15:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322992  77 58421 58516893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:15:17 [DEBUG   ] Got command RPT from MCS: ref #322993
2018-10-30 16:15:17 [DEBUG   ] summary = ERROR
2018-10-30 16:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322993  13 58421 58517085 A  ERRORERROR'
2018-10-30 16:15:17 [DEBUG   ] Got command RPT from MCS: ref #322995
2018-10-30 16:15:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322995  77 58421 58517289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:15:17 [DEBUG   ] Got command RPT from MCS: ref #322996
2018-10-30 16:15:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   322996  12 58421 58517493 A  ERRORB'
2018-10-30 16:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:15:19 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-10-30 16:15:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:15:39 [DEBUG   ] Got command RPT from MCS: ref #323005
2018-10-30 16:15:39 [DEBUG   ] summary = ERROR
2018-10-30 16:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323005  13 58421 58539881 A  ERRORERROR'
2018-10-30 16:15:39 [DEBUG   ] Got command RPT from MCS: ref #323006
2018-10-30 16:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323006  77 58421 58539882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:15:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 16:16:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:16:19 [DEBUG   ] Finished updating board flags in 1.734 seconds
2018-10-30 16:16:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 16:16:43 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-30 16:17:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 16:17:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:17:19 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-30 16:17:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 16:17:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 16:18:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 16:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 16:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:18:19 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-10-30 16:18:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 16:18:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:19:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 16:19:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:19:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:19:19 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-30 16:19:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:19:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 16:20:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:20:16 [DEBUG   ] Got command RPT from MCS: ref #323026
2018-10-30 16:20:16 [DEBUG   ] summary = ERROR
2018-10-30 16:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323026  13 58421 58816773 A  ERRORERROR'
2018-10-30 16:20:16 [DEBUG   ] Got command RPT from MCS: ref #323027
2018-10-30 16:20:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323027  77 58421 58816977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:20:17 [DEBUG   ] Got command RPT from MCS: ref #323028
2018-10-30 16:20:17 [DEBUG   ] summary = ERROR
2018-10-30 16:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323028  13 58421 58817181 A  ERRORERROR'
2018-10-30 16:20:17 [DEBUG   ] Got command RPT from MCS: ref #323029
2018-10-30 16:20:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323029  77 58421 58817373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:20:17 [DEBUG   ] Got command RPT from MCS: ref #323030
2018-10-30 16:20:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323030  12 58421 58817577 A  ERRORB'
2018-10-30 16:20:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:20:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:20:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:20:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:20:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:20:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:20:19 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-10-30 16:20:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 16:20:39 [DEBUG   ] Got command RPT from MCS: ref #323031
2018-10-30 16:20:39 [DEBUG   ] summary = ERROR
2018-10-30 16:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323031  13 58421 58839881 A  ERRORERROR'
2018-10-30 16:20:39 [DEBUG   ] Got command RPT from MCS: ref #323032
2018-10-30 16:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323032  77 58421 58839882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:20:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 16:21:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 16:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:21:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:21:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:21:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:21:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:21:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:21:19 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-30 16:21:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 16:21:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 16:22:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 16:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 16:22:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:22:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:22:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:22:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:22:19 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-10-30 16:22:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 16:22:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:23:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 16:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:23:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:23:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:23:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:23:19 [WARNING ] (13, 1, 'bot')
2018-10-30 16:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:23:19 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-10-30 16:23:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 16:23:43 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-30 16:24:04 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-30 16:24:11 [DEBUG   ] Got command TBW from MCS: ref #323053
2018-10-30 16:24:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-30 16:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   323053   8 58421 59051757 A  ERROR'
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-30 16:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-30 16:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-30 16:24:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-30 16:24:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-30 16:24:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-30 16:24:15 [DEBUG   ] spawn_process: at 2018-10-30 16:24:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-30 16:24:15 [INFO    ] Finished spawning TBW
2018-10-30 16:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:24:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:24:20 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-10-30 16:25:16 [DEBUG   ] Got command RPT from MCS: ref #323063
2018-10-30 16:25:16 [DEBUG   ] summary = ERROR
2018-10-30 16:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323063  13 58421 59116857 A  ERRORERROR'
2018-10-30 16:25:17 [DEBUG   ] Got command RPT from MCS: ref #323064
2018-10-30 16:25:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323064  77 58421 59117061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:25:17 [DEBUG   ] Got command RPT from MCS: ref #323065
2018-10-30 16:25:17 [DEBUG   ] summary = ERROR
2018-10-30 16:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323065  13 58421 59117265 A  ERRORERROR'
2018-10-30 16:25:17 [DEBUG   ] Got command RPT from MCS: ref #323067
2018-10-30 16:25:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323067  77 58421 59117457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:25:17 [DEBUG   ] Got command RPT from MCS: ref #323068
2018-10-30 16:25:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323068  12 58421 59117661 A  ERRORB'
2018-10-30 16:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:25:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:25:20 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-30 16:25:39 [DEBUG   ] Got command RPT from MCS: ref #323073
2018-10-30 16:25:39 [DEBUG   ] summary = ERROR
2018-10-30 16:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323073  13 58421 59139877 A  ERRORERROR'
2018-10-30 16:25:39 [DEBUG   ] Got command RPT from MCS: ref #323074
2018-10-30 16:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323074  77 58421 59139878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:26:03 [INFO    ] __waitForTBW - TBW finished in 108.477 s
2018-10-30 16:26:04 [DEBUG   ] Finished updating ant stats in 0.529 seconds
2018-10-30 16:26:04 [INFO    ] Started antennas statistics background thread
2018-10-30 16:26:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540916766']
2018-10-30 16:26:04 [DEBUG   ] spawn_process: at 2018-10-30 16:26:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540916766']
2018-10-30 16:26:04 [INFO    ] Finished spawning TBN in 0.048 s
2018-10-30 16:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:26:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:26:20 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-30 16:26:24 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2018-10-30 16:26:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 16:27:05 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2018-10-30 16:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:27:20 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-10-30 16:27:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 16:27:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:28:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 16:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:28:20 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-30 16:28:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:28:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:29:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:29:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:29:20 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-10-30 16:29:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:29:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:30:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:30:16 [DEBUG   ] Got command RPT from MCS: ref #323098
2018-10-30 16:30:16 [DEBUG   ] summary = ERROR
2018-10-30 16:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323098  13 58421 59416945 A  ERRORERROR'
2018-10-30 16:30:17 [DEBUG   ] Got command RPT from MCS: ref #323099
2018-10-30 16:30:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323099  77 58421 59417149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:30:17 [DEBUG   ] Got command RPT from MCS: ref #323100
2018-10-30 16:30:17 [DEBUG   ] summary = ERROR
2018-10-30 16:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323100  13 58421 59417353 A  ERRORERROR'
2018-10-30 16:30:17 [DEBUG   ] Got command RPT from MCS: ref #323101
2018-10-30 16:30:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323101  77 58421 59417545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:30:17 [DEBUG   ] Got command RPT from MCS: ref #323102
2018-10-30 16:30:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323102  12 58421 59417749 A  ERRORB'
2018-10-30 16:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:30:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:30:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:30:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:30:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:30:20 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-30 16:30:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:30:39 [DEBUG   ] Got command RPT from MCS: ref #323107
2018-10-30 16:30:39 [DEBUG   ] summary = ERROR
2018-10-30 16:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323107  13 58421 59439881 A  ERRORERROR'
2018-10-30 16:30:39 [DEBUG   ] Got command RPT from MCS: ref #323108
2018-10-30 16:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323108  77 58421 59439882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:30:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:31:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:31:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:31:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:31:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:31:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:31:20 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-10-30 16:31:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:31:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:32:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:32:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:32:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:32:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:32:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:32:20 [WARNING ] (13, 1, 'bot')
2018-10-30 16:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:32:20 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-30 16:32:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:32:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:33:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:33:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 16:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:33:21 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-10-30 16:33:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 16:33:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:34:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 16:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:34:21 [DEBUG   ] Finished updating board flags in 2.077 seconds
2018-10-30 16:34:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:34:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:35:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:35:17 [DEBUG   ] Got command RPT from MCS: ref #323130
2018-10-30 16:35:17 [DEBUG   ] summary = ERROR
2018-10-30 16:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323130  13 58421 59717029 A  ERRORERROR'
2018-10-30 16:35:17 [DEBUG   ] Got command RPT from MCS: ref #323131
2018-10-30 16:35:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323131  77 58421 59717233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:35:17 [DEBUG   ] Got command RPT from MCS: ref #323132
2018-10-30 16:35:17 [DEBUG   ] summary = ERROR
2018-10-30 16:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323132  13 58421 59717437 A  ERRORERROR'
2018-10-30 16:35:17 [DEBUG   ] Got command RPT from MCS: ref #323134
2018-10-30 16:35:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323134  77 58421 59717629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:35:17 [DEBUG   ] Got command RPT from MCS: ref #323135
2018-10-30 16:35:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323135  12 58421 59717833 A  ERRORB'
2018-10-30 16:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:35:21 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-10-30 16:35:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:35:39 [DEBUG   ] Got command RPT from MCS: ref #323140
2018-10-30 16:35:39 [DEBUG   ] summary = ERROR
2018-10-30 16:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323140  13 58421 59739885 A  ERRORERROR'
2018-10-30 16:35:39 [DEBUG   ] Got command RPT from MCS: ref #323141
2018-10-30 16:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323141  77 58421 59739886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:35:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:36:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 16:36:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:36:21 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-30 16:36:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 16:36:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:37:00 [DEBUG   ] Got command RPT from MCS: ref #323161
2018-10-30 16:37:00 [DEBUG   ] summary = ERROR
2018-10-30 16:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323161  13 58421 59820157 A  ERRORERROR'
2018-10-30 16:37:00 [DEBUG   ] Got command RPT from MCS: ref #323162
2018-10-30 16:37:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323162  77 58421 59820158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:37:05 [DEBUG   ] Got command INI from MCS: ref #323163
2018-10-30 16:37:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-30 16:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   323163   8 58421 59825169 ABOOTING'
2018-10-30 16:37:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:37:29 [INFO    ] -------------------
2018-10-30 16:37:29 [INFO    ]  LWA board status
2018-10-30 16:37:29 [INFO    ] -------------------
2018-10-30 16:37:29 [INFO    ] DP 1: 2 lwa27
2018-10-30 16:37:29 [INFO    ] DP 1: 3 lwa24
2018-10-30 16:37:29 [INFO    ] DP 1: 4 lwa23
2018-10-30 16:37:29 [INFO    ] DP 1: 5 lwa18
2018-10-30 16:37:29 [INFO    ] DP 1: 6 lwa10
2018-10-30 16:37:29 [INFO    ] DP 1: 7 lwa32
2018-10-30 16:37:29 [INFO    ] DP 1: 8 lwa11
2018-10-30 16:37:29 [INFO    ] DP 1: 9 lwa30
2018-10-30 16:37:29 [INFO    ] DP 1: 10 lwa12
2018-10-30 16:37:29 [INFO    ] DP 1: 11 lwa8
2018-10-30 16:37:29 [INFO    ] DP 1: 12 lwa13
2018-10-30 16:37:29 [INFO    ] DP 1: 13 lwa26
2018-10-30 16:37:29 [INFO    ] DP 1: 14 lwa14
2018-10-30 16:37:29 [INFO    ] DP 1: 16 lwa22
2018-10-30 16:37:29 [INFO    ] DP 1: 17 lwa20
2018-10-30 16:37:29 [INFO    ] DP 1: 18 lwa1
2018-10-30 16:37:29 [INFO    ] DP 1: 19 lwa5
2018-10-30 16:37:29 [INFO    ] DP 1: 20 lwa25
2018-10-30 16:37:29 [INFO    ] DP 1: 21 lwa35
2018-10-30 16:37:29 [INFO    ] DP 1: 22 lwa19
2018-10-30 16:37:29 [INFO    ] DP 1: 23 lwa21
2018-10-30 16:37:29 [INFO    ] DP 1: 24 lwa6
2018-10-30 16:37:29 [INFO    ] DP 1: 25 lwa7
2018-10-30 16:37:29 [INFO    ] DP 1: 26 lwa33
2018-10-30 16:37:29 [INFO    ] DP 1: 27 lwa15
2018-10-30 16:37:29 [INFO    ] DP 1: 28 lwa28
2018-10-30 16:37:29 [INFO    ] DP 2: 1 lwa16
2018-10-30 16:37:29 [INFO    ] DP 2: 15 lwa34
2018-10-30 16:37:29 [INFO    ] Total of 28 boards
2018-10-30 16:37:29 [INFO    ] Total of 260 stands
2018-10-30 16:37:29 [INFO    ] -------------------
2018-10-30 16:37:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4049
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4050
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4051
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4052
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4053
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4054
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4055
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4056
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4057
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4058
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4059
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4060
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4061
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4062
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4063
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4064
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4065
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4066
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4067
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4068
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4069
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4070
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4071
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4072
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4073
2018-10-30 16:37:36 [DEBUG   ] 2018-10-30 16:37:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4074
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4049 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4050 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4051 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4052 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4053 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4054 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4055 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4056 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4057 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4058 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4059 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4060 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4061 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4062 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4063 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4064 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4065 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4066 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4067 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4068 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4069 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4070 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4071 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4072 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4073 exited with status 0
2018-10-30 16:37:48 [DEBUG   ] 2018-10-30 16:37:48 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4074 exited with status 0
2018-10-30 16:37:48 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:48 [DEBUG   ] spawn_process: at 2018-10-30 16:37:48 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] spawn_process: at 2018-10-30 16:37:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] spawn_process: at 2018-10-30 16:37:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] spawn_process: at 2018-10-30 16:37:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] spawn_process: at 2018-10-30 16:37:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] spawn_process: at 2018-10-30 16:37:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] spawn_process: at 2018-10-30 16:37:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-30 16:37:49 [DEBUG   ] 2018-10-30 16:37:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4101
2018-10-30 16:37:49 [DEBUG   ] 2018-10-30 16:37:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4102
2018-10-30 16:37:54 [DEBUG   ] 2018-10-30 16:37:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4101 exited with status 0
2018-10-30 16:37:54 [DEBUG   ] 2018-10-30 16:37:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4102 exited with status 0
2018-10-30 16:37:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-30 16:37:54 [DEBUG   ] spawn_process: at 2018-10-30 16:37:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-30 16:37:54 [DEBUG   ] spawn_process: at 2018-10-30 16:37:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-30 16:37:54 [INFO    ] Setting Beam 1 xbars
2018-10-30 16:37:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-30 16:37:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-30 16:37:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-30 16:37:54 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-30 16:37:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-30 16:37:56 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-30 16:37:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-30 16:37:57 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-30 16:37:58 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-30 16:37:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-30 16:38:00 [INFO    ] Setting Beam 2 xbars
2018-10-30 16:38:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-30 16:38:00 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-30 16:38:01 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-30 16:38:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-30 16:38:03 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-30 16:38:04 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-30 16:38:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-30 16:38:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-30 16:38:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-30 16:38:05 [INFO    ] Setting Beam 3 xbars
2018-10-30 16:38:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-30 16:38:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-30 16:38:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-30 16:38:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-30 16:38:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-30 16:38:05 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-30 16:38:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-30 16:38:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-30 16:38:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-30 16:38:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-30 16:38:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-30 16:38:10 [INFO    ] Setting Beam 4 xbars
2018-10-30 16:38:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-30 16:38:10 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-30 16:38:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-30 16:38:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-30 16:38:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-30 16:38:14 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-30 16:38:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-30 16:38:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-30 16:38:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-30 16:38:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-30 16:38:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-30 16:38:16 [INFO    ] All xbars set
2018-10-30 16:38:16 [INFO    ] Setting adder chain routing for all beams
2018-10-30 16:38:21 [INFO    ] Setting beam ids
2018-10-30 16:38:31 [INFO    ] Starting beam delay calibration
2018-10-30 16:38:43 [INFO    ] Beam 1 latency is 5716
2018-10-30 16:38:43 [INFO    ] Beam 2 latency is 5730
2018-10-30 16:38:43 [INFO    ] Beam 3 latency is 5722
2018-10-30 16:38:43 [INFO    ] Beam 4 latency is 5713
2018-10-30 16:38:43 [INFO    ] Stop calibration
2018-10-30 16:38:51 [INFO    ] Beam delay calibration successful
2018-10-30 16:38:51 [INFO    ] Calibration passed
2018-10-30 16:38:51 [DEBUG   ] spawn_process: at 2018-10-30 16:38:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-30 16:38:51 [DEBUG   ] spawn_process: at 2018-10-30 16:38:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-30 16:38:51 [DEBUG   ] spawn_process: at 2018-10-30 16:38:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-30 16:38:51 [DEBUG   ] spawn_process: at 2018-10-30 16:38:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-30 16:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-30 16:38:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-30 16:38:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1540917532.273 s) with PID 5680 and time 1540917533
2018-10-30 16:38:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-30 16:38:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 360 ms (1540917532.362 s) with PID 5683 and time 1540917533
2018-10-30 16:38:53 [DEBUG   ] Finished updating ant stats in 0.885 seconds
2018-10-30 16:38:53 [INFO    ] Started antennas statistics background thread
2018-10-30 16:38:53 [INFO    ] Started board flags background thread
2018-10-30 16:38:53 [INFO    ] Started BAM background thread
2018-10-30 16:38:53 [INFO    ] Finished the INI process (ref. #323163) in 108.316 s
2018-10-30 16:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:38:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:38:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:38:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:38:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:38:54 [DEBUG   ] Finished updating board flags in 1.075 seconds
2018-10-30 16:39:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 16:39:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:39:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 16:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:39:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:39:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:39:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:39:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:39:54 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-10-30 16:40:05 [DEBUG   ] Got command RPT from MCS: ref #323168
2018-10-30 16:40:05 [DEBUG   ] summary = ERROR
2018-10-30 16:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323168  13 58421 60005161 A  ERRORERROR'
2018-10-30 16:40:05 [DEBUG   ] Got command RPT from MCS: ref #323169
2018-10-30 16:40:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323169  77 58421 60005162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:40:13 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-10-30 16:40:17 [DEBUG   ] Got command RPT from MCS: ref #323170
2018-10-30 16:40:17 [DEBUG   ] summary = ERROR
2018-10-30 16:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323170  13 58421 60017117 A  ERRORERROR'
2018-10-30 16:40:17 [DEBUG   ] Got command RPT from MCS: ref #323171
2018-10-30 16:40:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323171  77 58421 60017321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:40:17 [DEBUG   ] Got command RPT from MCS: ref #323172
2018-10-30 16:40:17 [DEBUG   ] summary = ERROR
2018-10-30 16:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323172  13 58421 60017525 A  ERRORERROR'
2018-10-30 16:40:17 [DEBUG   ] Got command RPT from MCS: ref #323173
2018-10-30 16:40:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323173  77 58421 60017729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:40:17 [DEBUG   ] Got command RPT from MCS: ref #323174
2018-10-30 16:40:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323174  12 58421 60017921 A  ERRORB'
2018-10-30 16:40:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 16:40:39 [DEBUG   ] Got command RPT from MCS: ref #323175
2018-10-30 16:40:39 [DEBUG   ] summary = ERROR
2018-10-30 16:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323175  13 58421 60039881 A  ERRORERROR'
2018-10-30 16:40:39 [DEBUG   ] Got command RPT from MCS: ref #323176
2018-10-30 16:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323176  77 58421 60039882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:40:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:40:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:40:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:40:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:40:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:40:54 [DEBUG   ] Finished updating board flags in 1.274 seconds
2018-10-30 16:41:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:41:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:41:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 16:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:41:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:41:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:41:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:41:54 [WARNING ] (13, 1, 'bot')
2018-10-30 16:41:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:41:54 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-10-30 16:42:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:42:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 16:42:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:42:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:42:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:42:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:42:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:42:55 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-30 16:43:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 16:43:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 16:43:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:43:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:43:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:43:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:43:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:43:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:43:55 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-30 16:44:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 16:44:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:44:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 16:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:44:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:44:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:44:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:44:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:44:55 [DEBUG   ] Finished updating board flags in 1.252 seconds
2018-10-30 16:45:13 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 16:45:17 [DEBUG   ] Got command RPT from MCS: ref #323198
2018-10-30 16:45:17 [DEBUG   ] summary = ERROR
2018-10-30 16:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323198  13 58421 60317213 A  ERRORERROR'
2018-10-30 16:45:17 [DEBUG   ] Got command RPT from MCS: ref #323199
2018-10-30 16:45:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323199  77 58421 60317405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:45:17 [DEBUG   ] Got command RPT from MCS: ref #323200
2018-10-30 16:45:17 [DEBUG   ] summary = ERROR
2018-10-30 16:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323200  13 58421 60317609 A  ERRORERROR'
2018-10-30 16:45:17 [DEBUG   ] Got command RPT from MCS: ref #323202
2018-10-30 16:45:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323202  77 58421 60317813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:45:18 [DEBUG   ] Got command RPT from MCS: ref #323203
2018-10-30 16:45:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323203  12 58421 60318005 A  ERRORB'
2018-10-30 16:45:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:45:39 [DEBUG   ] Got command RPT from MCS: ref #323212
2018-10-30 16:45:39 [DEBUG   ] summary = ERROR
2018-10-30 16:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323212  13 58421 60339885 A  ERRORERROR'
2018-10-30 16:45:39 [DEBUG   ] Got command RPT from MCS: ref #323213
2018-10-30 16:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323213  77 58421 60339886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:45:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:45:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:45:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:45:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:45:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:45:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:45:55 [DEBUG   ] Finished updating board flags in 1.146 seconds
2018-10-30 16:46:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:46:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:46:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:46:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:46:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:46:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:46:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:46:55 [DEBUG   ] Finished updating board flags in 1.039 seconds
2018-10-30 16:47:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:47:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:47:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:47:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:47:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:47:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:47:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:47:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:47:56 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-30 16:48:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:48:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:48:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:48:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:48:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:48:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:48:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:48:56 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-10-30 16:49:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:49:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:49:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:49:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:49:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:49:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:49:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:49:55 [DEBUG   ] Finished updating board flags in 1.285 seconds
2018-10-30 16:50:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:50:17 [DEBUG   ] Got command RPT from MCS: ref #323233
2018-10-30 16:50:17 [DEBUG   ] summary = ERROR
2018-10-30 16:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323233  13 58421 60617293 A  ERRORERROR'
2018-10-30 16:50:17 [DEBUG   ] Got command RPT from MCS: ref #323234
2018-10-30 16:50:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323234  77 58421 60617497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:50:17 [DEBUG   ] Got command RPT from MCS: ref #323235
2018-10-30 16:50:17 [DEBUG   ] summary = ERROR
2018-10-30 16:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323235  13 58421 60617701 A  ERRORERROR'
2018-10-30 16:50:17 [DEBUG   ] Got command RPT from MCS: ref #323236
2018-10-30 16:50:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323236  77 58421 60617893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:50:18 [DEBUG   ] Got command RPT from MCS: ref #323237
2018-10-30 16:50:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323237  12 58421 60618097 A  ERRORB'
2018-10-30 16:50:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:50:39 [DEBUG   ] Got command RPT from MCS: ref #323238
2018-10-30 16:50:39 [DEBUG   ] summary = ERROR
2018-10-30 16:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323238  13 58421 60639881 A  ERRORERROR'
2018-10-30 16:50:39 [DEBUG   ] Got command RPT from MCS: ref #323239
2018-10-30 16:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323239  77 58421 60639882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:50:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:50:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:50:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:50:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:50:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:50:55 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-10-30 16:51:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:51:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:51:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 16:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:51:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:51:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:51:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:51:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:51:55 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-30 16:52:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:52:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:52:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 16:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:52:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:52:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:52:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:52:55 [WARNING ] (13, 1, 'bot')
2018-10-30 16:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:52:55 [DEBUG   ] Finished updating board flags in 1.143 seconds
2018-10-30 16:53:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:53:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:53:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:53:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:53:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:53:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:53:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:53:56 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-30 16:54:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:54:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:54:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:54:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:54:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:54:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:54:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:54:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:54:56 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-30 16:55:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:55:17 [DEBUG   ] Got command RPT from MCS: ref #323265
2018-10-30 16:55:17 [DEBUG   ] summary = ERROR
2018-10-30 16:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323265  13 58421 60917381 A  ERRORERROR'
2018-10-30 16:55:17 [DEBUG   ] Got command RPT from MCS: ref #323266
2018-10-30 16:55:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323266  77 58421 60917573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:55:17 [DEBUG   ] Got command RPT from MCS: ref #323267
2018-10-30 16:55:17 [DEBUG   ] summary = ERROR
2018-10-30 16:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323267  13 58421 60917777 A  ERRORERROR'
2018-10-30 16:55:17 [DEBUG   ] Got command RPT from MCS: ref #323269
2018-10-30 16:55:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323269  77 58421 60917981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:55:18 [DEBUG   ] Got command RPT from MCS: ref #323270
2018-10-30 16:55:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 16:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323270  12 58421 60918185 A  ERRORB'
2018-10-30 16:55:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:55:39 [DEBUG   ] Got command RPT from MCS: ref #323275
2018-10-30 16:55:39 [DEBUG   ] summary = ERROR
2018-10-30 16:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323275  13 58421 60939881 A  ERRORERROR'
2018-10-30 16:55:39 [DEBUG   ] Got command RPT from MCS: ref #323276
2018-10-30 16:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 16:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323276  77 58421 60939882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 16:55:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:55:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:55:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:55:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:55:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:55:56 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-10-30 16:56:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:56:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:56:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:56:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:56:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:56:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:56:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:56:56 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-10-30 16:57:10 [DEBUG   ] Got command DRX from MCS: ref #323297
2018-10-30 16:57:10 [INFO    ] sending drx command to lwa34
2018-10-30 16:57:10 [DEBUG   ] run_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2018-10-30 16:57:10 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   323297   8 58421 61030009 A  ERROR'
2018-10-30 16:57:10 [DEBUG   ] Got command DRX from MCS: ref #323296
2018-10-30 16:57:10 [INFO    ] sending drx command to lwa16
2018-10-30 16:57:10 [DEBUG   ] run_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 0']
2018-10-30 16:57:10 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   323296   8 58421 61030013 A  ERROR'
2018-10-30 16:57:10 [DEBUG   ] Got command DRX from MCS: ref #323298
2018-10-30 16:57:10 [INFO    ] sending drx command to lwa16
2018-10-30 16:57:10 [DEBUG   ] run_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 0']
2018-10-30 16:57:10 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   323298   8 58421 61030017 A  ERROR'
2018-10-30 16:57:10 [DEBUG   ] Got command DRX from MCS: ref #323299
2018-10-30 16:57:10 [INFO    ] sending drx command to lwa34
2018-10-30 16:57:10 [DEBUG   ] run_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2018-10-30 16:57:10 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   323299   8 58421 61030021 A  ERROR'
2018-10-30 16:57:10 [DEBUG   ] Got command BAM from MCS: ref #323301
2018-10-30 16:57:10 [INFO    ] Finished processing BAM request
2018-10-30 16:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323301   8 58421 61030025 A  ERROR'
2018-10-30 16:57:10 [DEBUG   ] Got command BAM from MCS: ref #323300
2018-10-30 16:57:10 [INFO    ] Finished processing BAM request
2018-10-30 16:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323300   8 58421 61030029 A  ERROR'
2018-10-30 16:57:10 [INFO    ] Finished starting DRX
2018-10-30 16:57:10 [INFO    ] Finished starting DRX
2018-10-30 16:57:10 [INFO    ] Finished starting DRX
2018-10-30 16:57:10 [INFO    ] Finished starting DRX
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 16:57:10 [DEBUG   ] spawn_process: at 2018-10-30 16:57:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 16:57:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:57:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:57:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:57:57 [WARNING ] (13, 1, 'bot')
2018-10-30 16:57:57 [WARNING ] (13, 1, 'bot')
2018-10-30 16:57:57 [WARNING ] (13, 1, 'bot')
2018-10-30 16:57:57 [WARNING ] (13, 1, 'bot')
2018-10-30 16:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:57:57 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-30 16:58:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:58:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:58:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 16:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:58:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 16:58:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:58:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:58:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:58:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:58:56 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-30 16:59:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:59:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:59:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 16:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 16:59:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:59:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:59:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:59:56 [WARNING ] (13, 1, 'bot')
2018-10-30 16:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 16:59:56 [DEBUG   ] Finished updating board flags in 1.261 seconds
2018-10-30 17:00:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:00:17 [DEBUG   ] Got command RPT from MCS: ref #323308
2018-10-30 17:00:17 [DEBUG   ] summary = ERROR
2018-10-30 17:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323308  13 58421 61217461 A  ERRORERROR'
2018-10-30 17:00:17 [DEBUG   ] Got command RPT from MCS: ref #323309
2018-10-30 17:00:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323309  77 58421 61217665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:00:17 [DEBUG   ] Got command RPT from MCS: ref #323310
2018-10-30 17:00:17 [DEBUG   ] summary = ERROR
2018-10-30 17:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323310  13 58421 61217869 A  ERRORERROR'
2018-10-30 17:00:18 [DEBUG   ] Got command RPT from MCS: ref #323311
2018-10-30 17:00:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323311  77 58421 61218073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:00:18 [DEBUG   ] Got command RPT from MCS: ref #323312
2018-10-30 17:00:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323312  12 58421 61218265 A  ERRORBff'
2018-10-30 17:00:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:00:39 [DEBUG   ] Got command RPT from MCS: ref #323317
2018-10-30 17:00:39 [DEBUG   ] summary = ERROR
2018-10-30 17:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323317  13 58421 61239889 A  ERRORERROR'
2018-10-30 17:00:39 [DEBUG   ] Got command RPT from MCS: ref #323318
2018-10-30 17:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323318  77 58421 61239890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:00:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 17:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:00:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:00:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:00:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:00:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:00:56 [DEBUG   ] Finished updating board flags in 1.150 seconds
2018-10-30 17:01:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:01:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:01:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:01:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:01:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 17:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:01:56 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-10-30 17:02:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:02:34 [DEBUG   ] Got command BAM from MCS: ref #323334
2018-10-30 17:02:34 [INFO    ] Finished processing BAM request
2018-10-30 17:02:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323334   8 58421 61354029 A  ERROR'
2018-10-30 17:02:34 [DEBUG   ] Got command BAM from MCS: ref #323335
2018-10-30 17:02:34 [INFO    ] Finished processing BAM request
2018-10-30 17:02:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323335   8 58421 61354033 A  ERROR'
2018-10-30 17:02:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 17:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 17:02:34 [DEBUG   ] spawn_process: at 2018-10-30 17:02:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 17:02:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 17:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:02:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:02:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:02:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:02:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:02:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:02:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:02:57 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-10-30 17:03:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:03:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:03:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:03:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:03:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:03:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:03:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:03:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:03:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:03:57 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-10-30 17:04:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:04:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:04:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:04:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:04:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:04:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:04:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:04:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:04:57 [DEBUG   ] Finished updating board flags in 1.239 seconds
2018-10-30 17:05:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:05:17 [DEBUG   ] Got command RPT from MCS: ref #323342
2018-10-30 17:05:17 [DEBUG   ] summary = ERROR
2018-10-30 17:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323342  13 58421 61517545 A  ERRORERROR'
2018-10-30 17:05:17 [DEBUG   ] Got command RPT from MCS: ref #323343
2018-10-30 17:05:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323343  77 58421 61517749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:05:17 [DEBUG   ] Got command RPT from MCS: ref #323344
2018-10-30 17:05:17 [DEBUG   ] summary = ERROR
2018-10-30 17:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323344  13 58421 61517953 A  ERRORERROR'
2018-10-30 17:05:18 [DEBUG   ] Got command RPT from MCS: ref #323346
2018-10-30 17:05:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323346  77 58421 61518157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:05:18 [DEBUG   ] Got command RPT from MCS: ref #323347
2018-10-30 17:05:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323347  12 58421 61518349 A  ERRORBŁff'
2018-10-30 17:05:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:05:39 [DEBUG   ] Got command RPT from MCS: ref #323352
2018-10-30 17:05:39 [DEBUG   ] summary = ERROR
2018-10-30 17:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323352  13 58421 61539889 A  ERRORERROR'
2018-10-30 17:05:39 [DEBUG   ] Got command RPT from MCS: ref #323353
2018-10-30 17:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323353  77 58421 61539890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:05:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-10-30 17:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 17:05:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:05:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:05:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:05:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:05:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:05:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:05:57 [DEBUG   ] Finished updating board flags in 1.159 seconds
2018-10-30 17:06:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:06:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:06:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:06:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:06:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:06:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:06:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:06:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:06:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:06:57 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-10-30 17:07:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:07:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:07:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:07:55 [DEBUG   ] Got command BAM from MCS: ref #323374
2018-10-30 17:07:55 [INFO    ] Finished processing BAM request
2018-10-30 17:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323374   8 58421 61675025 A  ERROR'
2018-10-30 17:07:55 [DEBUG   ] Got command BAM from MCS: ref #323373
2018-10-30 17:07:55 [INFO    ] Finished processing BAM request
2018-10-30 17:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323373   8 58421 61675029 A  ERROR'
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 17:07:55 [DEBUG   ] spawn_process: at 2018-10-30 17:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 17:07:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:07:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 17:07:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:07:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:07:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:07:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:07:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:07:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:07:57 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-10-30 17:08:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 17:08:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:08:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-30 17:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 17:08:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:08:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:08:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:08:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:08:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:08:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:08:58 [DEBUG   ] Finished updating board flags in 1.862 seconds
2018-10-30 17:09:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:09:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:09:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:09:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 17:09:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 17:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:09:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:09:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:09:57 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-10-30 17:10:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:10:17 [DEBUG   ] Got command RPT from MCS: ref #323379
2018-10-30 17:10:17 [DEBUG   ] summary = ERROR
2018-10-30 17:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323379  13 58421 61817637 A  ERRORERROR'
2018-10-30 17:10:17 [DEBUG   ] Got command RPT from MCS: ref #323380
2018-10-30 17:10:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323380  77 58421 61817841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:10:18 [DEBUG   ] Got command RPT from MCS: ref #323381
2018-10-30 17:10:18 [DEBUG   ] summary = ERROR
2018-10-30 17:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323381  13 58421 61818064 A  ERRORERROR'
2018-10-30 17:10:18 [DEBUG   ] Got command RPT from MCS: ref #323382
2018-10-30 17:10:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323382  77 58421 61818241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:10:18 [DEBUG   ] Got command RPT from MCS: ref #323383
2018-10-30 17:10:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323383  12 58421 61818445 A  ERRORB¤ff'
2018-10-30 17:10:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:10:39 [DEBUG   ] Got command RPT from MCS: ref #323384
2018-10-30 17:10:39 [DEBUG   ] summary = ERROR
2018-10-30 17:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323384  13 58421 61839885 A  ERRORERROR'
2018-10-30 17:10:39 [DEBUG   ] Got command RPT from MCS: ref #323385
2018-10-30 17:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323385  77 58421 61839886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:10:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 17:10:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:10:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:10:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:10:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:10:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:10:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:10:57 [DEBUG   ] Finished updating board flags in 1.053 seconds
2018-10-30 17:11:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:11:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:11:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:11:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:11:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-10-30 17:11:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:11:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:11:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:11:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:11:57 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-10-30 17:12:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:12:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:12:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-30 17:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:12:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:12:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:12:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:12:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:12:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:12:57 [WARNING ] (13, 1, 'bot')
2018-10-30 17:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:12:57 [DEBUG   ] Finished updating board flags in 0.942 seconds
2018-10-30 17:13:14 [DEBUG   ] Got command BAM from MCS: ref #323405
2018-10-30 17:13:14 [INFO    ] Finished processing BAM request
2018-10-30 17:13:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323405   8 58421 61994029 A  ERROR'
2018-10-30 17:13:14 [DEBUG   ] Got command BAM from MCS: ref #323406
2018-10-30 17:13:14 [INFO    ] Finished processing BAM request
2018-10-30 17:13:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323406   8 58421 61994033 A  ERROR'
2018-10-30 17:13:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 17:13:14 [DEBUG   ] spawn_process: at 2018-10-30 17:13:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 17:13:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:13:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:13:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:13:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:13:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:13:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:13:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:13:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:13:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:13:58 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-30 17:14:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:14:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:14:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 17:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 17:14:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:14:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:14:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:14:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:14:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:14:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:14:58 [DEBUG   ] Finished updating board flags in 1.247 seconds
2018-10-30 17:15:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:15:17 [DEBUG   ] Got command RPT from MCS: ref #323409
2018-10-30 17:15:17 [DEBUG   ] summary = ERROR
2018-10-30 17:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323409  13 58421 62117725 A  ERRORERROR'
2018-10-30 17:15:17 [DEBUG   ] Got command RPT from MCS: ref #323410
2018-10-30 17:15:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323410  77 58421 62117917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:15:18 [DEBUG   ] Got command RPT from MCS: ref #323411
2018-10-30 17:15:18 [DEBUG   ] summary = ERROR
2018-10-30 17:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323411  13 58421 62118121 A  ERRORERROR'
2018-10-30 17:15:18 [DEBUG   ] Got command RPT from MCS: ref #323413
2018-10-30 17:15:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323413  77 58421 62118325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:15:18 [DEBUG   ] Got command RPT from MCS: ref #323414
2018-10-30 17:15:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323414  12 58421 62118529 A  ERRORB¤ff'
2018-10-30 17:15:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:15:39 [DEBUG   ] Got command RPT from MCS: ref #323423
2018-10-30 17:15:39 [DEBUG   ] summary = ERROR
2018-10-30 17:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323423  13 58421 62139885 A  ERRORERROR'
2018-10-30 17:15:39 [DEBUG   ] Got command RPT from MCS: ref #323424
2018-10-30 17:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323424  77 58421 62139886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:15:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 17:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 17:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 17:15:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:15:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:15:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:15:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:15:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:15:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:15:58 [DEBUG   ] Finished updating board flags in 1.161 seconds
2018-10-30 17:16:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:16:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:16:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:16:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-30 17:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:16:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:16:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:16:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:16:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:16:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:16:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:16:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:16:58 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-30 17:17:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:17:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:17:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 17:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:17:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:17:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:17:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:17:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:17:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:17:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:17:58 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-30 17:18:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:18:31 [DEBUG   ] Got command BAM from MCS: ref #323440
2018-10-30 17:18:31 [INFO    ] Finished processing BAM request
2018-10-30 17:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323440   8 58421 62311033 A  ERROR'
2018-10-30 17:18:31 [DEBUG   ] Got command BAM from MCS: ref #323441
2018-10-30 17:18:31 [INFO    ] Finished processing BAM request
2018-10-30 17:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323441   8 58421 62311037 A  ERROR'
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 17:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 17:18:31 [DEBUG   ] spawn_process: at 2018-10-30 17:18:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 17:18:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:18:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:18:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 17:18:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:18:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:18:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:18:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:18:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:18:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:18:59 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-10-30 17:19:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:19:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 17:19:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 17:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:19:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:19:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:19:58 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-30 17:20:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 17:20:17 [DEBUG   ] Got command RPT from MCS: ref #323446
2018-10-30 17:20:17 [DEBUG   ] summary = ERROR
2018-10-30 17:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323446  13 58421 62417809 A  ERRORERROR'
2018-10-30 17:20:18 [DEBUG   ] Got command RPT from MCS: ref #323447
2018-10-30 17:20:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323447  77 58421 62418001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:20:18 [DEBUG   ] Got command RPT from MCS: ref #323448
2018-10-30 17:20:18 [DEBUG   ] summary = ERROR
2018-10-30 17:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323448  13 58421 62418205 A  ERRORERROR'
2018-10-30 17:20:18 [DEBUG   ] Got command RPT from MCS: ref #323449
2018-10-30 17:20:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323449  77 58421 62418409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:20:18 [DEBUG   ] Got command RPT from MCS: ref #323450
2018-10-30 17:20:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323450  12 58421 62418613 A  ERRORBŁff'
2018-10-30 17:20:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:20:39 [DEBUG   ] Got command RPT from MCS: ref #323451
2018-10-30 17:20:39 [DEBUG   ] summary = ERROR
2018-10-30 17:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323451  13 58421 62439885 A  ERRORERROR'
2018-10-30 17:20:39 [DEBUG   ] Got command RPT from MCS: ref #323452
2018-10-30 17:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323452  77 58421 62439886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:20:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:20:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:20:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:20:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:20:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:20:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:20:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:20:58 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-10-30 17:21:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:21:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:21:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:21:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:21:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:21:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:21:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:21:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:21:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:21:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:21:58 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-10-30 17:22:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 17:22:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:22:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:22:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:22:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:22:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:22:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:22:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:22:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:22:58 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-10-30 17:23:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:23:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:23:47 [DEBUG   ] Got command BAM from MCS: ref #323473
2018-10-30 17:23:47 [INFO    ] Finished processing BAM request
2018-10-30 17:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323473   8 58421 62627033 A  ERROR'
2018-10-30 17:23:47 [DEBUG   ] Got command BAM from MCS: ref #323472
2018-10-30 17:23:47 [INFO    ] Finished processing BAM request
2018-10-30 17:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323472   8 58421 62627037 A  ERROR'
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 17:23:47 [DEBUG   ] spawn_process: at 2018-10-30 17:23:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 17:23:54 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-10-30 17:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:23:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:23:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:23:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:23:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:23:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:23:58 [WARNING ] (13, 1, 'bot')
2018-10-30 17:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:23:58 [DEBUG   ] Finished updating board flags in 0.960 seconds
2018-10-30 17:24:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 17:24:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:24:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:24:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:24:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:24:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:24:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:24:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:24:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:24:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:24:59 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-30 17:25:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:25:17 [DEBUG   ] Got command RPT from MCS: ref #323480
2018-10-30 17:25:17 [DEBUG   ] summary = ERROR
2018-10-30 17:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323480  13 58421 62717893 A  ERRORERROR'
2018-10-30 17:25:18 [DEBUG   ] Got command RPT from MCS: ref #323481
2018-10-30 17:25:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323481  77 58421 62718098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:25:18 [DEBUG   ] Got command RPT from MCS: ref #323482
2018-10-30 17:25:18 [DEBUG   ] summary = ERROR
2018-10-30 17:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323482  13 58421 62718289 A  ERRORERROR'
2018-10-30 17:25:18 [DEBUG   ] Got command RPT from MCS: ref #323484
2018-10-30 17:25:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323484  77 58421 62718493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:25:18 [DEBUG   ] Got command RPT from MCS: ref #323485
2018-10-30 17:25:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323485  12 58421 62718697 A  ERRORBŁff'
2018-10-30 17:25:35 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-30 17:25:39 [DEBUG   ] Got command RPT from MCS: ref #323490
2018-10-30 17:25:39 [DEBUG   ] summary = ERROR
2018-10-30 17:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323490  13 58421 62739893 A  ERRORERROR'
2018-10-30 17:25:39 [DEBUG   ] Got command RPT from MCS: ref #323491
2018-10-30 17:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323491  77 58421 62739894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:25:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:25:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:25:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:25:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:25:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:25:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:25:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:25:59 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-10-30 17:26:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:26:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:26:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 17:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:26:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:26:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:26:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:26:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:26:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:26:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:26:59 [DEBUG   ] Finished updating board flags in 1.060 seconds
2018-10-30 17:27:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:27:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:27:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 17:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 17:28:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:28:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:28:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:28:00 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-30 17:28:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 17:28:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:28:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:28:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:28:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:28:59 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-30 17:29:01 [DEBUG   ] Got command BAM from MCS: ref #323512
2018-10-30 17:29:01 [INFO    ] Finished processing BAM request
2018-10-30 17:29:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323512   8 58421 62941025 A  ERROR'
2018-10-30 17:29:01 [DEBUG   ] Got command BAM from MCS: ref #323511
2018-10-30 17:29:01 [INFO    ] Finished processing BAM request
2018-10-30 17:29:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323511   8 58421 62941029 A  ERROR'
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 17:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 17:29:01 [DEBUG   ] spawn_process: at 2018-10-30 17:29:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 17:29:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:29:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 17:29:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:29:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:29:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:29:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:29:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:29:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:29:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:29:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:29:59 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-30 17:30:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 17:30:17 [DEBUG   ] Got command RPT from MCS: ref #323513
2018-10-30 17:30:17 [DEBUG   ] summary = ERROR
2018-10-30 17:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323513  13 58421 63017977 A  ERRORERROR'
2018-10-30 17:30:18 [DEBUG   ] Got command RPT from MCS: ref #323514
2018-10-30 17:30:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323514  77 58421 63018181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:30:18 [DEBUG   ] Got command RPT from MCS: ref #323515
2018-10-30 17:30:18 [DEBUG   ] summary = ERROR
2018-10-30 17:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323515  13 58421 63018373 A  ERRORERROR'
2018-10-30 17:30:18 [DEBUG   ] Got command RPT from MCS: ref #323516
2018-10-30 17:30:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323516  77 58421 63018577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:30:18 [DEBUG   ] Got command RPT from MCS: ref #323517
2018-10-30 17:30:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323517  12 58421 63018781 A  ERRORB¤ff'
2018-10-30 17:30:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 17:30:39 [DEBUG   ] Got command RPT from MCS: ref #323522
2018-10-30 17:30:39 [DEBUG   ] summary = ERROR
2018-10-30 17:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323522  13 58421 63039889 A  ERRORERROR'
2018-10-30 17:30:39 [DEBUG   ] Got command RPT from MCS: ref #323523
2018-10-30 17:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323523  77 58421 63039890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:30:56 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-10-30 17:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:30:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:30:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:30:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:30:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:30:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:30:59 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-30 17:31:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 17:31:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 17:31:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 17:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 17:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:31:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:31:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:31:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:31:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:31:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:31:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:31:59 [DEBUG   ] Finished updating board flags in 1.164 seconds
2018-10-30 17:32:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 17:32:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:32:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:32:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:32:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:32:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:32:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:32:59 [WARNING ] (13, 1, 'bot')
2018-10-30 17:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:32:59 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-10-30 17:33:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:33:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 17:33:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 17:34:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:34:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:34:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:34:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:34:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:34:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:34:00 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-30 17:34:14 [DEBUG   ] Got command BAM from MCS: ref #323543
2018-10-30 17:34:14 [INFO    ] Finished processing BAM request
2018-10-30 17:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323543   8 58421 63254029 A  ERROR'
2018-10-30 17:34:14 [DEBUG   ] Got command BAM from MCS: ref #323544
2018-10-30 17:34:14 [INFO    ] Finished processing BAM request
2018-10-30 17:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323544   8 58421 63254033 A  ERROR'
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 17:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 17:34:14 [DEBUG   ] spawn_process: at 2018-10-30 17:34:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 17:34:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:34:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:34:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 17:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:35:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:35:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:35:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:35:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:35:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:35:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:35:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:35:00 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-30 17:35:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:35:18 [DEBUG   ] Got command RPT from MCS: ref #323547
2018-10-30 17:35:18 [DEBUG   ] summary = ERROR
2018-10-30 17:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323547  13 58421 63318061 A  ERRORERROR'
2018-10-30 17:35:18 [DEBUG   ] Got command RPT from MCS: ref #323548
2018-10-30 17:35:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323548  77 58421 63318265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:35:18 [DEBUG   ] Got command RPT from MCS: ref #323549
2018-10-30 17:35:18 [DEBUG   ] summary = ERROR
2018-10-30 17:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323549  13 58421 63318457 A  ERRORERROR'
2018-10-30 17:35:18 [DEBUG   ] Got command RPT from MCS: ref #323551
2018-10-30 17:35:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323551  77 58421 63318661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:35:18 [DEBUG   ] Got command RPT from MCS: ref #323553
2018-10-30 17:35:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323553  12 58421 63318865 A  ERRORBŁff'
2018-10-30 17:35:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:35:39 [DEBUG   ] Got command RPT from MCS: ref #323557
2018-10-30 17:35:39 [DEBUG   ] summary = ERROR
2018-10-30 17:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323557  13 58421 63339893 A  ERRORERROR'
2018-10-30 17:35:39 [DEBUG   ] Got command RPT from MCS: ref #323558
2018-10-30 17:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323558  77 58421 63339894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:35:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:36:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:36:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:36:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:36:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:36:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:36:00 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-30 17:36:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:36:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:36:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:37:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:37:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 17:37:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:37:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:37:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:37:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:37:00 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-10-30 17:37:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 17:37:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 17:37:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 17:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:38:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:38:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:38:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:38:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:38:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:38:00 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-10-30 17:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:38:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:38:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:38:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 17:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:39:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:39:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:39:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:39:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:39:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:39:00 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-10-30 17:39:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:39:26 [DEBUG   ] Got command BAM from MCS: ref #323578
2018-10-30 17:39:26 [INFO    ] Finished processing BAM request
2018-10-30 17:39:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323578   8 58421 63566029 A  ERROR'
2018-10-30 17:39:26 [DEBUG   ] Got command BAM from MCS: ref #323579
2018-10-30 17:39:26 [INFO    ] Finished processing BAM request
2018-10-30 17:39:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323579   8 58421 63566033 A  ERROR'
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 17:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 17:39:26 [DEBUG   ] spawn_process: at 2018-10-30 17:39:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 17:39:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:39:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:39:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:40:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:40:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:40:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:40:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:40:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:40:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:40:00 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-10-30 17:40:16 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-30 17:40:18 [DEBUG   ] Got command RPT from MCS: ref #323584
2018-10-30 17:40:18 [DEBUG   ] summary = ERROR
2018-10-30 17:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323584  13 58421 63618145 A  ERRORERROR'
2018-10-30 17:40:18 [DEBUG   ] Got command RPT from MCS: ref #323585
2018-10-30 17:40:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323585  77 58421 63618349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:40:18 [DEBUG   ] Got command RPT from MCS: ref #323586
2018-10-30 17:40:18 [DEBUG   ] summary = ERROR
2018-10-30 17:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323586  13 58421 63618553 A  ERRORERROR'
2018-10-30 17:40:18 [DEBUG   ] Got command RPT from MCS: ref #323587
2018-10-30 17:40:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323587  77 58421 63618745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:40:18 [DEBUG   ] Got command RPT from MCS: ref #323588
2018-10-30 17:40:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323588  12 58421 63618949 A  ERRORB¤ff'
2018-10-30 17:40:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:40:39 [DEBUG   ] Got command RPT from MCS: ref #323589
2018-10-30 17:40:39 [DEBUG   ] summary = ERROR
2018-10-30 17:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323589  13 58421 63639893 A  ERRORERROR'
2018-10-30 17:40:39 [DEBUG   ] Got command RPT from MCS: ref #323590
2018-10-30 17:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323590  77 58421 63639894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:40:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 17:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:41:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:41:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:41:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:41:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:41:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:41:01 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-30 17:41:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 17:41:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:41:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:42:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:42:00 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-10-30 17:42:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:42:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:42:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 17:43:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:43:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:43:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:43:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:43:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:43:00 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-10-30 17:43:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:43:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:43:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 17:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:44:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:44:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:44:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:44:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:44:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:44:01 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-30 17:44:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:44:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:44:38 [DEBUG   ] Got command BAM from MCS: ref #323610
2018-10-30 17:44:38 [INFO    ] Finished processing BAM request
2018-10-30 17:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323610   8 58421 63878025 A  ERROR'
2018-10-30 17:44:38 [DEBUG   ] Got command BAM from MCS: ref #323611
2018-10-30 17:44:38 [INFO    ] Finished processing BAM request
2018-10-30 17:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323611   8 58421 63878029 A  ERROR'
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 17:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 17:44:38 [DEBUG   ] spawn_process: at 2018-10-30 17:44:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 17:44:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 17:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:45:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:45:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:45:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:45:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:45:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:45:00 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-10-30 17:45:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 17:45:18 [DEBUG   ] Got command RPT from MCS: ref #323614
2018-10-30 17:45:18 [DEBUG   ] summary = ERROR
2018-10-30 17:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323614  13 58421 63918229 A  ERRORERROR'
2018-10-30 17:45:18 [DEBUG   ] Got command RPT from MCS: ref #323615
2018-10-30 17:45:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323615  77 58421 63918433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:45:18 [DEBUG   ] Got command RPT from MCS: ref #323616
2018-10-30 17:45:18 [DEBUG   ] summary = ERROR
2018-10-30 17:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323616  13 58421 63918637 A  ERRORERROR'
2018-10-30 17:45:18 [DEBUG   ] Got command RPT from MCS: ref #323618
2018-10-30 17:45:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323618  77 58421 63918829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:45:19 [DEBUG   ] Got command RPT from MCS: ref #323620
2018-10-30 17:45:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323620  12 58421 63919033 A  ERRORBŁff'
2018-10-30 17:45:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:45:39 [DEBUG   ] Got command RPT from MCS: ref #323628
2018-10-30 17:45:39 [DEBUG   ] summary = ERROR
2018-10-30 17:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323628  13 58421 63939897 A  ERRORERROR'
2018-10-30 17:45:39 [DEBUG   ] Got command RPT from MCS: ref #323629
2018-10-30 17:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323629  77 58421 63939898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:45:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 17:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:46:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 17:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:46:00 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-10-30 17:46:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:46:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:46:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 17:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:47:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:47:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:47:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:47:01 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-10-30 17:47:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:47:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:47:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:48:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:48:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:48:01 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-30 17:48:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:48:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:48:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:49:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:49:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:49:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:49:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:49:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:49:01 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-10-30 17:49:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:49:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:49:49 [DEBUG   ] Got command BAM from MCS: ref #323650
2018-10-30 17:49:49 [INFO    ] Finished processing BAM request
2018-10-30 17:49:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323650   8 58421 64189029 A  ERROR'
2018-10-30 17:49:49 [DEBUG   ] Got command BAM from MCS: ref #323649
2018-10-30 17:49:49 [INFO    ] Finished processing BAM request
2018-10-30 17:49:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323649   8 58421 64189033 A  ERROR'
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 17:49:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 17:49:49 [DEBUG   ] spawn_process: at 2018-10-30 17:49:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 17:49:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:50:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:50:01 [DEBUG   ] Finished updating board flags in 1.266 seconds
2018-10-30 17:50:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:50:18 [DEBUG   ] Got command RPT from MCS: ref #323651
2018-10-30 17:50:18 [DEBUG   ] summary = ERROR
2018-10-30 17:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323651  13 58421 64218317 A  ERRORERROR'
2018-10-30 17:50:18 [DEBUG   ] Got command RPT from MCS: ref #323652
2018-10-30 17:50:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323652  77 58421 64218521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:50:18 [DEBUG   ] Got command RPT from MCS: ref #323653
2018-10-30 17:50:18 [DEBUG   ] summary = ERROR
2018-10-30 17:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323653  13 58421 64218725 A  ERRORERROR'
2018-10-30 17:50:18 [DEBUG   ] Got command RPT from MCS: ref #323654
2018-10-30 17:50:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323654  77 58421 64218921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:50:19 [DEBUG   ] Got command RPT from MCS: ref #323655
2018-10-30 17:50:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323655  12 58421 64219125 A  ERRORBŁff'
2018-10-30 17:50:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:50:39 [DEBUG   ] Got command RPT from MCS: ref #323656
2018-10-30 17:50:39 [DEBUG   ] summary = ERROR
2018-10-30 17:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323656  13 58421 64239893 A  ERRORERROR'
2018-10-30 17:50:39 [DEBUG   ] Got command RPT from MCS: ref #323657
2018-10-30 17:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323657  77 58421 64239894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:50:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:51:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:51:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:51:01 [DEBUG   ] Finished updating board flags in 1.137 seconds
2018-10-30 17:51:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 17:51:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 17:51:57 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-30 17:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:52:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:52:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:52:01 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-10-30 17:52:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:52:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:52:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 17:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 17:53:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 17:53:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:53:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:53:01 [DEBUG   ] Finished updating board flags in 1.268 seconds
2018-10-30 17:53:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:53:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:53:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:54:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:54:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:54:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:54:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:54:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:54:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:54:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:54:01 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-10-30 17:54:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:54:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:54:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 17:55:00 [DEBUG   ] Got command BAM from MCS: ref #323683
2018-10-30 17:55:00 [INFO    ] Finished processing BAM request
2018-10-30 17:55:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323683   8 58421 64500025 A  ERROR'
2018-10-30 17:55:00 [DEBUG   ] Got command BAM from MCS: ref #323684
2018-10-30 17:55:00 [INFO    ] Finished processing BAM request
2018-10-30 17:55:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 17:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323684   8 58421 64500029 A  ERROR'
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 17:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 17:55:00 [DEBUG   ] spawn_process: at 2018-10-30 17:55:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 17:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 17:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 17:55:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:55:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:55:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:55:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:55:01 [WARNING ] (13, 1, 'bot')
2018-10-30 17:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:55:01 [DEBUG   ] Finished updating board flags in 1.152 seconds
2018-10-30 17:55:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:55:18 [DEBUG   ] Got command RPT from MCS: ref #323685
2018-10-30 17:55:18 [DEBUG   ] summary = ERROR
2018-10-30 17:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323685  13 58421 64518413 A  ERRORERROR'
2018-10-30 17:55:18 [DEBUG   ] Got command RPT from MCS: ref #323686
2018-10-30 17:55:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323686  77 58421 64518605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:55:18 [DEBUG   ] Got command RPT from MCS: ref #323687
2018-10-30 17:55:18 [DEBUG   ] summary = ERROR
2018-10-30 17:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323687  13 58421 64518809 A  ERRORERROR'
2018-10-30 17:55:19 [DEBUG   ] Got command RPT from MCS: ref #323689
2018-10-30 17:55:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323689  77 58421 64519013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:55:19 [DEBUG   ] Got command RPT from MCS: ref #323691
2018-10-30 17:55:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 17:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323691  12 58421 64519205 A  ERRORB˘ff'
2018-10-30 17:55:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:55:39 [DEBUG   ] Got command RPT from MCS: ref #323695
2018-10-30 17:55:39 [DEBUG   ] summary = ERROR
2018-10-30 17:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323695  13 58421 64539897 A  ERRORERROR'
2018-10-30 17:55:39 [DEBUG   ] Got command RPT from MCS: ref #323696
2018-10-30 17:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 17:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323696  77 58421 64539898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 17:55:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 17:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 17:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 17:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 17:56:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 17:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:56:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:56:02 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-30 17:56:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:56:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:56:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 17:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 17:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 17:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 17:57:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:57:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:57:02 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-10-30 17:57:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 17:57:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:57:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:58:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:58:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 17:58:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 17:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:58:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:58:02 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-30 17:58:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 17:58:37 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-30 17:58:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 17:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 17:59:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 17:59:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 17:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:59:02 [WARNING ] (13, 1, 'bot')
2018-10-30 17:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 17:59:02 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-30 17:59:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:59:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 17:59:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:00:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-30 18:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:00:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:00:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:00:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:00:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:00:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:00:02 [DEBUG   ] Finished updating board flags in 1.210 seconds
2018-10-30 18:00:11 [DEBUG   ] Got command BAM from MCS: ref #323717
2018-10-30 18:00:11 [INFO    ] Finished processing BAM request
2018-10-30 18:00:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323717   8 58421 64811025 A  ERROR'
2018-10-30 18:00:11 [DEBUG   ] Got command BAM from MCS: ref #323716
2018-10-30 18:00:11 [INFO    ] Finished processing BAM request
2018-10-30 18:00:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323716   8 58421 64811029 A  ERROR'
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 18:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 18:00:11 [DEBUG   ] spawn_process: at 2018-10-30 18:00:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 18:00:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:00:18 [DEBUG   ] Got command RPT from MCS: ref #323718
2018-10-30 18:00:18 [DEBUG   ] summary = ERROR
2018-10-30 18:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323718  13 58421 64818489 A  ERRORERROR'
2018-10-30 18:00:18 [DEBUG   ] Got command RPT from MCS: ref #323719
2018-10-30 18:00:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323719  77 58421 64818693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:00:18 [DEBUG   ] Got command RPT from MCS: ref #323720
2018-10-30 18:00:18 [DEBUG   ] summary = ERROR
2018-10-30 18:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323720  13 58421 64818897 A  ERRORERROR'
2018-10-30 18:00:19 [DEBUG   ] Got command RPT from MCS: ref #323721
2018-10-30 18:00:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323721  77 58421 64819089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:00:19 [DEBUG   ] Got command RPT from MCS: ref #323722
2018-10-30 18:00:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323722  12 58421 64819293 A  ERRORBŁff'
2018-10-30 18:00:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:00:39 [DEBUG   ] Got command RPT from MCS: ref #323727
2018-10-30 18:00:39 [DEBUG   ] summary = ERROR
2018-10-30 18:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323727  13 58421 64839909 A  ERRORERROR'
2018-10-30 18:00:39 [DEBUG   ] Got command RPT from MCS: ref #323728
2018-10-30 18:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323728  77 58421 64839910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:00:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 18:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:01:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:01:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:01:02 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-10-30 18:01:17 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 18:01:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:01:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:02:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:02:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:02:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:02:02 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-10-30 18:02:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:02:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:02:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:03:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:03:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:03:02 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-10-30 18:03:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:03:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:03:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 18:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:04:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-10-30 18:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:04:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:04:02 [DEBUG   ] Finished updating board flags in 1.059 seconds
2018-10-30 18:04:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:04:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:04:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:05:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:05:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:05:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:05:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:05:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:05:03 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-30 18:05:18 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2018-10-30 18:05:18 [DEBUG   ] Got command RPT from MCS: ref #323750
2018-10-30 18:05:18 [DEBUG   ] summary = ERROR
2018-10-30 18:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323750  13 58421 65118573 A  ERRORERROR'
2018-10-30 18:05:18 [DEBUG   ] Got command RPT from MCS: ref #323751
2018-10-30 18:05:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323751  77 58421 65118777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:05:18 [DEBUG   ] Got command RPT from MCS: ref #323752
2018-10-30 18:05:18 [DEBUG   ] summary = ERROR
2018-10-30 18:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323752  13 58421 65118981 A  ERRORERROR'
2018-10-30 18:05:19 [DEBUG   ] Got command RPT from MCS: ref #323753
2018-10-30 18:05:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323753  77 58421 65119173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:05:19 [DEBUG   ] Got command RPT from MCS: ref #323755
2018-10-30 18:05:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323755  12 58421 65119377 A  ERRORBŁff'
2018-10-30 18:05:22 [DEBUG   ] Got command BAM from MCS: ref #323760
2018-10-30 18:05:22 [INFO    ] Finished processing BAM request
2018-10-30 18:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323760   8 58421 65122033 A  ERROR'
2018-10-30 18:05:22 [DEBUG   ] Got command BAM from MCS: ref #323761
2018-10-30 18:05:22 [INFO    ] Finished processing BAM request
2018-10-30 18:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323761   8 58421 65122037 A  ERROR'
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 18:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 18:05:22 [DEBUG   ] spawn_process: at 2018-10-30 18:05:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 18:05:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:05:39 [DEBUG   ] Got command RPT from MCS: ref #323762
2018-10-30 18:05:39 [DEBUG   ] summary = ERROR
2018-10-30 18:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323762  13 58421 65139898 A  ERRORERROR'
2018-10-30 18:05:39 [DEBUG   ] Got command RPT from MCS: ref #323763
2018-10-30 18:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323763  77 58421 65139898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:05:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 18:06:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:06:02 [WARNING ] (13, 1, 'bot')
2018-10-30 18:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:06:02 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-10-30 18:06:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:06:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:06:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:07:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:07:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:07:03 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-30 18:07:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:07:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:07:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:08:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:08:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:08:03 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-30 18:08:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:08:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:08:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 18:09:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:09:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:09:03 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-10-30 18:09:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:09:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:09:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 18:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:10:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:10:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:10:03 [DEBUG   ] Finished updating board flags in 1.277 seconds
2018-10-30 18:10:18 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-30 18:10:18 [DEBUG   ] Got command RPT from MCS: ref #323787
2018-10-30 18:10:18 [DEBUG   ] summary = ERROR
2018-10-30 18:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323787  13 58421 65418661 A  ERRORERROR'
2018-10-30 18:10:18 [DEBUG   ] Got command RPT from MCS: ref #323788
2018-10-30 18:10:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323788  77 58421 65418865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:10:19 [DEBUG   ] Got command RPT from MCS: ref #323789
2018-10-30 18:10:19 [DEBUG   ] summary = ERROR
2018-10-30 18:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323789  13 58421 65419057 A  ERRORERROR'
2018-10-30 18:10:19 [DEBUG   ] Got command RPT from MCS: ref #323790
2018-10-30 18:10:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323790  77 58421 65419261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:10:19 [DEBUG   ] Got command RPT from MCS: ref #323791
2018-10-30 18:10:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323791  12 58421 65419465 A  ERRORB¤ff'
2018-10-30 18:10:34 [DEBUG   ] Got command BAM from MCS: ref #323793
2018-10-30 18:10:34 [INFO    ] Finished processing BAM request
2018-10-30 18:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323793   8 58421 65434029 A  ERROR'
2018-10-30 18:10:34 [DEBUG   ] Got command BAM from MCS: ref #323792
2018-10-30 18:10:34 [INFO    ] Finished processing BAM request
2018-10-30 18:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323792   8 58421 65434033 A  ERROR'
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 18:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 18:10:34 [DEBUG   ] spawn_process: at 2018-10-30 18:10:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 18:10:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:10:39 [DEBUG   ] Got command RPT from MCS: ref #323794
2018-10-30 18:10:39 [DEBUG   ] summary = ERROR
2018-10-30 18:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323794  13 58421 65439901 A  ERRORERROR'
2018-10-30 18:10:39 [DEBUG   ] Got command RPT from MCS: ref #323795
2018-10-30 18:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323795  77 58421 65439902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:10:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:11:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:11:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:11:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:11:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:11:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:11:03 [DEBUG   ] Finished updating board flags in 1.112 seconds
2018-10-30 18:11:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:11:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:11:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:12:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:12:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:12:03 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-10-30 18:12:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:12:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:12:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 18:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:13:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:13:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:13:03 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-10-30 18:13:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 18:13:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:13:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:14:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 18:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 18:14:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:14:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:14:03 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-30 18:14:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:14:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:14:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 18:15:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 18:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:15:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:15:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:15:03 [DEBUG   ] Finished updating board flags in 0.982 seconds
2018-10-30 18:15:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 18:15:18 [DEBUG   ] Got command RPT from MCS: ref #323817
2018-10-30 18:15:18 [DEBUG   ] summary = ERROR
2018-10-30 18:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323817  13 58421 65718745 A  ERRORERROR'
2018-10-30 18:15:18 [DEBUG   ] Got command RPT from MCS: ref #323818
2018-10-30 18:15:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323818  77 58421 65718949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:15:19 [DEBUG   ] Got command RPT from MCS: ref #323819
2018-10-30 18:15:19 [DEBUG   ] summary = ERROR
2018-10-30 18:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323819  13 58421 65719153 A  ERRORERROR'
2018-10-30 18:15:19 [DEBUG   ] Got command RPT from MCS: ref #323821
2018-10-30 18:15:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323821  77 58421 65719345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:15:19 [DEBUG   ] Got command RPT from MCS: ref #323822
2018-10-30 18:15:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323822  12 58421 65719549 A  ERRORBŁff'
2018-10-30 18:15:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:15:39 [DEBUG   ] Got command RPT from MCS: ref #323831
2018-10-30 18:15:39 [DEBUG   ] summary = ERROR
2018-10-30 18:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323831  13 58421 65739901 A  ERRORERROR'
2018-10-30 18:15:39 [DEBUG   ] Got command RPT from MCS: ref #323832
2018-10-30 18:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323832  77 58421 65739902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:15:46 [DEBUG   ] Got command BAM from MCS: ref #323848
2018-10-30 18:15:46 [INFO    ] Finished processing BAM request
2018-10-30 18:15:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:15:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323848   8 58421 65746025 A  ERROR'
2018-10-30 18:15:46 [DEBUG   ] Got command BAM from MCS: ref #323849
2018-10-30 18:15:46 [INFO    ] Finished processing BAM request
2018-10-30 18:15:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:15:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323849   8 58421 65746029 A  ERROR'
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 18:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 18:15:46 [DEBUG   ] spawn_process: at 2018-10-30 18:15:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 18:15:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 18:16:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:16:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:16:03 [DEBUG   ] Finished updating board flags in 1.274 seconds
2018-10-30 18:16:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:16:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:16:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:17:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:17:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:17:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:17:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:17:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:17:03 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-10-30 18:17:19 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-30 18:17:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:17:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 18:18:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:18:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:18:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:18:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:18:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:18:03 [DEBUG   ] Finished updating board flags in 1.247 seconds
2018-10-30 18:18:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:18:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:18:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:19:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:19:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:19:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:19:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:19:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:19:03 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-10-30 18:19:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:19:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:19:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:20:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:20:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:20:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:20:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:20:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:20:03 [DEBUG   ] Finished updating board flags in 1.113 seconds
2018-10-30 18:20:18 [DEBUG   ] Got command RPT from MCS: ref #323854
2018-10-30 18:20:18 [DEBUG   ] summary = ERROR
2018-10-30 18:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323854  13 58421 66018837 A  ERRORERROR'
2018-10-30 18:20:19 [DEBUG   ] Got command RPT from MCS: ref #323855
2018-10-30 18:20:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323855  77 58421 66019029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:20:19 [DEBUG   ] Got command RPT from MCS: ref #323856
2018-10-30 18:20:19 [DEBUG   ] summary = ERROR
2018-10-30 18:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323856  13 58421 66019233 A  ERRORERROR'
2018-10-30 18:20:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 18:20:19 [DEBUG   ] Got command RPT from MCS: ref #323857
2018-10-30 18:20:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323857  77 58421 66019437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:20:19 [DEBUG   ] Got command RPT from MCS: ref #323858
2018-10-30 18:20:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323858  12 58421 66019641 A  ERRORB˘ff'
2018-10-30 18:20:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:20:39 [DEBUG   ] Got command RPT from MCS: ref #323859
2018-10-30 18:20:39 [DEBUG   ] summary = ERROR
2018-10-30 18:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323859  13 58421 66039909 A  ERRORERROR'
2018-10-30 18:20:39 [DEBUG   ] Got command RPT from MCS: ref #323860
2018-10-30 18:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323860  77 58421 66039910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:20:59 [DEBUG   ] Got command BAM from MCS: ref #323876
2018-10-30 18:20:59 [INFO    ] Finished processing BAM request
2018-10-30 18:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323876   8 58421 66059029 A  ERROR'
2018-10-30 18:20:59 [DEBUG   ] Got command BAM from MCS: ref #323877
2018-10-30 18:20:59 [INFO    ] Finished processing BAM request
2018-10-30 18:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323877   8 58421 66059033 A  ERROR'
2018-10-30 18:20:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 18:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 18:20:59 [DEBUG   ] spawn_process: at 2018-10-30 18:20:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 18:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:21:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:21:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:21:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:21:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:21:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:21:03 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-10-30 18:21:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:21:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:21:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 18:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 18:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:22:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:22:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:22:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:22:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:22:03 [WARNING ] (13, 1, 'bot')
2018-10-30 18:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:22:03 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-10-30 18:22:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:22:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:22:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:23:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:23:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:23:04 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-10-30 18:23:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:23:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 18:23:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:24:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:24:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:24:04 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-30 18:24:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 18:24:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:24:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:25:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:25:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:25:04 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-30 18:25:18 [DEBUG   ] Got command RPT from MCS: ref #323888
2018-10-30 18:25:18 [DEBUG   ] summary = ERROR
2018-10-30 18:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323888  13 58421 66318913 A  ERRORERROR'
2018-10-30 18:25:19 [DEBUG   ] Got command RPT from MCS: ref #323889
2018-10-30 18:25:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323889  77 58421 66319121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:25:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:25:19 [DEBUG   ] Got command RPT from MCS: ref #323890
2018-10-30 18:25:19 [DEBUG   ] summary = ERROR
2018-10-30 18:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323890  13 58421 66319325 A  ERRORERROR'
2018-10-30 18:25:19 [DEBUG   ] Got command RPT from MCS: ref #323892
2018-10-30 18:25:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323892  77 58421 66319517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:25:19 [DEBUG   ] Got command RPT from MCS: ref #323894
2018-10-30 18:25:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323894  12 58421 66319721 A  ERRORBŁff'
2018-10-30 18:25:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:25:39 [DEBUG   ] Got command RPT from MCS: ref #323898
2018-10-30 18:25:39 [DEBUG   ] summary = ERROR
2018-10-30 18:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323898  13 58421 66339909 A  ERRORERROR'
2018-10-30 18:25:39 [DEBUG   ] Got command RPT from MCS: ref #323899
2018-10-30 18:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323899  77 58421 66339910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:25:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 18:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:26:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:26:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:26:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:26:04 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-30 18:26:13 [DEBUG   ] Got command BAM from MCS: ref #323915
2018-10-30 18:26:13 [INFO    ] Finished processing BAM request
2018-10-30 18:26:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323915   8 58421 66373033 A  ERROR'
2018-10-30 18:26:13 [DEBUG   ] Got command BAM from MCS: ref #323916
2018-10-30 18:26:13 [INFO    ] Finished processing BAM request
2018-10-30 18:26:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323916   8 58421 66373037 A  ERROR'
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 18:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 18:26:13 [DEBUG   ] spawn_process: at 2018-10-30 18:26:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 18:26:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:26:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:26:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-30 18:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 18:27:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:27:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:27:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:27:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:27:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:27:04 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-10-30 18:27:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:27:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:27:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 18:28:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:28:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:28:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:28:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:28:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:28:04 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-10-30 18:28:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:28:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 18:28:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:29:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:29:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:29:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:29:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:29:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:29:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:29:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:29:04 [DEBUG   ] Finished updating board flags in 1.127 seconds
2018-10-30 18:29:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:29:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:29:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 18:30:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:30:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:30:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:30:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:30:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:30:04 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-10-30 18:30:19 [DEBUG   ] Got command RPT from MCS: ref #323921
2018-10-30 18:30:19 [DEBUG   ] summary = ERROR
2018-10-30 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323921  13 58421 66619009 A  ERRORERROR'
2018-10-30 18:30:19 [DEBUG   ] Got command RPT from MCS: ref #323922
2018-10-30 18:30:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323922  77 58421 66619209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:30:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:30:19 [DEBUG   ] Got command RPT from MCS: ref #323923
2018-10-30 18:30:19 [DEBUG   ] summary = ERROR
2018-10-30 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323923  13 58421 66619413 A  ERRORERROR'
2018-10-30 18:30:19 [DEBUG   ] Got command RPT from MCS: ref #323924
2018-10-30 18:30:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323924  77 58421 66619605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:30:19 [DEBUG   ] Got command RPT from MCS: ref #323925
2018-10-30 18:30:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323925  12 58421 66619809 A  ERRORB˘ff'
2018-10-30 18:30:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:30:39 [DEBUG   ] Got command RPT from MCS: ref #323930
2018-10-30 18:30:39 [DEBUG   ] summary = ERROR
2018-10-30 18:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323930  13 58421 66639905 A  ERRORERROR'
2018-10-30 18:30:39 [DEBUG   ] Got command RPT from MCS: ref #323931
2018-10-30 18:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323931  77 58421 66639906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:30:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-30 18:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 18:31:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:31:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:31:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:31:05 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-30 18:31:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 18:31:28 [DEBUG   ] Got command BAM from MCS: ref #323948
2018-10-30 18:31:28 [INFO    ] Finished processing BAM request
2018-10-30 18:31:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323948   8 58421 66688033 A  ERROR'
2018-10-30 18:31:28 [DEBUG   ] Got command BAM from MCS: ref #323947
2018-10-30 18:31:28 [INFO    ] Finished processing BAM request
2018-10-30 18:31:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323947   8 58421 66688037 A  ERROR'
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 18:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 18:31:28 [DEBUG   ] spawn_process: at 2018-10-30 18:31:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 18:31:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:31:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:32:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:32:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:32:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:32:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:32:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:32:04 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-10-30 18:32:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:32:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:32:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 18:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:33:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:33:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:33:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:33:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:33:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:33:04 [DEBUG   ] Finished updating board flags in 1.286 seconds
2018-10-30 18:33:19 [DEBUG   ] Finished updating ant stats in 0.386 seconds
2018-10-30 18:33:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:34:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:34:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:34:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:34:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:34:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:34:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:34:04 [DEBUG   ] Finished updating board flags in 1.108 seconds
2018-10-30 18:34:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:34:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:35:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:35:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:35:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:35:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:35:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:35:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:35:04 [DEBUG   ] Finished updating board flags in 1.025 seconds
2018-10-30 18:35:19 [DEBUG   ] Got command RPT from MCS: ref #323955
2018-10-30 18:35:19 [DEBUG   ] summary = ERROR
2018-10-30 18:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323955  13 58421 66919090 A  ERRORERROR'
2018-10-30 18:35:19 [DEBUG   ] Got command RPT from MCS: ref #323956
2018-10-30 18:35:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323956  77 58421 66919293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:35:19 [DEBUG   ] Got command RPT from MCS: ref #323957
2018-10-30 18:35:19 [DEBUG   ] summary = ERROR
2018-10-30 18:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323957  13 58421 66919489 A  ERRORERROR'
2018-10-30 18:35:19 [DEBUG   ] Got command RPT from MCS: ref #323959
2018-10-30 18:35:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323959  77 58421 66919693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:35:19 [DEBUG   ] Got command RPT from MCS: ref #323960
2018-10-30 18:35:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323960  12 58421 66919897 A  ERRORBŁff'
2018-10-30 18:35:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:35:39 [DEBUG   ] Got command RPT from MCS: ref #323965
2018-10-30 18:35:39 [DEBUG   ] summary = ERROR
2018-10-30 18:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323965  13 58421 66939918 A  ERRORERROR'
2018-10-30 18:35:39 [DEBUG   ] Got command RPT from MCS: ref #323966
2018-10-30 18:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323966  77 58421 66939918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:35:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:36:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 18:36:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:36:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:36:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:36:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:36:04 [WARNING ] (13, 1, 'bot')
2018-10-30 18:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:36:04 [DEBUG   ] Finished updating board flags in 0.976 seconds
2018-10-30 18:36:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:36:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:36:45 [DEBUG   ] Got command BAM from MCS: ref #323986
2018-10-30 18:36:45 [INFO    ] Finished processing BAM request
2018-10-30 18:36:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323986   8 58421 67005029 A  ERROR'
2018-10-30 18:36:45 [DEBUG   ] Got command BAM from MCS: ref #323987
2018-10-30 18:36:45 [INFO    ] Finished processing BAM request
2018-10-30 18:36:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   323987   8 58421 67005033 A  ERROR'
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 18:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 18:36:45 [DEBUG   ] spawn_process: at 2018-10-30 18:36:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 18:37:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:37:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:37:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:37:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:37:05 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-10-30 18:37:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:37:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:38:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 18:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 18:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 18:38:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:38:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:38:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:38:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:38:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:38:05 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-10-30 18:38:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:38:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:39:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:39:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:39:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:39:05 [DEBUG   ] Finished updating board flags in 1.276 seconds
2018-10-30 18:39:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:39:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:40:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:40:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:40:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:40:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:40:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:40:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:40:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:40:05 [DEBUG   ] Finished updating board flags in 1.165 seconds
2018-10-30 18:40:19 [DEBUG   ] Got command RPT from MCS: ref #323992
2018-10-30 18:40:19 [DEBUG   ] summary = ERROR
2018-10-30 18:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323992  13 58421 67219169 A  ERRORERROR'
2018-10-30 18:40:19 [DEBUG   ] Got command RPT from MCS: ref #323993
2018-10-30 18:40:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323993  77 58421 67219373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:40:19 [DEBUG   ] Got command RPT from MCS: ref #323994
2018-10-30 18:40:19 [DEBUG   ] summary = ERROR
2018-10-30 18:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323994  13 58421 67219577 A  ERRORERROR'
2018-10-30 18:40:19 [DEBUG   ] Got command RPT from MCS: ref #323995
2018-10-30 18:40:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323995  77 58421 67219781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:40:19 [DEBUG   ] Got command RPT from MCS: ref #323996
2018-10-30 18:40:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323996  12 58421 67219973 A  ERRORBŁff'
2018-10-30 18:40:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 18:40:39 [DEBUG   ] Got command RPT from MCS: ref #323997
2018-10-30 18:40:39 [DEBUG   ] summary = ERROR
2018-10-30 18:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323997  13 58421 67239918 A  ERRORERROR'
2018-10-30 18:40:39 [DEBUG   ] Got command RPT from MCS: ref #323998
2018-10-30 18:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   323998  77 58421 67239919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:40:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:41:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 18:41:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:41:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:41:06 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-30 18:41:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:41:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:42:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:42:04 [DEBUG   ] Got command BAM from MCS: ref #324015
2018-10-30 18:42:04 [INFO    ] Finished processing BAM request
2018-10-30 18:42:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:42:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   324015   8 58421 67324029 A  ERROR'
2018-10-30 18:42:04 [DEBUG   ] Got command BAM from MCS: ref #324014
2018-10-30 18:42:04 [INFO    ] Finished processing BAM request
2018-10-30 18:42:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:42:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   324014   8 58421 67324033 A  ERROR'
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 18:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 18:42:04 [DEBUG   ] spawn_process: at 2018-10-30 18:42:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 18:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:42:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 18:42:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:42:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:42:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:42:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:42:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:42:05 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-30 18:42:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:42:40 [DEBUG   ] Finished updating ant stats in 0.966 seconds
2018-10-30 18:43:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-10-30 18:43:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:43:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:43:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:43:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:43:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:43:05 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-30 18:43:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:43:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:44:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:44:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:44:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:44:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:44:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:44:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:44:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:44:05 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-30 18:44:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:44:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:45:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 18:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 18:45:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:45:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:45:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:45:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:45:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:45:05 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-30 18:45:19 [DEBUG   ] Got command RPT from MCS: ref #324022
2018-10-30 18:45:19 [DEBUG   ] summary = ERROR
2018-10-30 18:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324022  13 58421 67519257 A  ERRORERROR'
2018-10-30 18:45:19 [DEBUG   ] Got command RPT from MCS: ref #324023
2018-10-30 18:45:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324023  77 58421 67519454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:45:19 [DEBUG   ] Got command RPT from MCS: ref #324024
2018-10-30 18:45:19 [DEBUG   ] summary = ERROR
2018-10-30 18:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324024  13 58421 67519661 A  ERRORERROR'
2018-10-30 18:45:19 [DEBUG   ] Got command RPT from MCS: ref #324026
2018-10-30 18:45:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324026  77 58421 67519857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:45:20 [DEBUG   ] Got command RPT from MCS: ref #324027
2018-10-30 18:45:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324027  12 58421 67520061 A  ERRORB˘ff'
2018-10-30 18:45:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:45:39 [DEBUG   ] Got command RPT from MCS: ref #324036
2018-10-30 18:45:39 [DEBUG   ] summary = ERROR
2018-10-30 18:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324036  13 58421 67539909 A  ERRORERROR'
2018-10-30 18:45:39 [DEBUG   ] Got command RPT from MCS: ref #324037
2018-10-30 18:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324037  77 58421 67539910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:45:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:46:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 18:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 18:46:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:46:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:46:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:46:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:46:05 [WARNING ] (13, 1, 'bot')
2018-10-30 18:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:46:05 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-10-30 18:46:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:46:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:47:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:47:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:47:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:47:06 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-30 18:47:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:47:25 [DEBUG   ] Got command BAM from MCS: ref #324053
2018-10-30 18:47:25 [INFO    ] Finished processing BAM request
2018-10-30 18:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   324053   8 58421 67645025 A  ERROR'
2018-10-30 18:47:25 [DEBUG   ] Got command BAM from MCS: ref #324054
2018-10-30 18:47:25 [INFO    ] Finished processing BAM request
2018-10-30 18:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   324054   8 58421 67645029 A  ERROR'
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 18:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 18:47:25 [DEBUG   ] spawn_process: at 2018-10-30 18:47:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 18:47:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:48:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:48:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:48:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:48:06 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-10-30 18:48:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:48:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:49:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 18:49:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:49:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:49:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:49:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:49:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:49:06 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-30 18:49:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:49:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 18:50:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 18:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:50:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:50:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:50:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:50:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:50:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:50:06 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-30 18:50:19 [DEBUG   ] Got command RPT from MCS: ref #324059
2018-10-30 18:50:19 [DEBUG   ] summary = ERROR
2018-10-30 18:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324059  13 58421 67819349 A  ERRORERROR'
2018-10-30 18:50:19 [DEBUG   ] Got command RPT from MCS: ref #324060
2018-10-30 18:50:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324060  77 58421 67819541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:50:19 [DEBUG   ] Got command RPT from MCS: ref #324061
2018-10-30 18:50:19 [DEBUG   ] summary = ERROR
2018-10-30 18:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324061  13 58421 67819745 A  ERRORERROR'
2018-10-30 18:50:19 [DEBUG   ] Got command RPT from MCS: ref #324062
2018-10-30 18:50:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324062  77 58421 67819949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:50:20 [DEBUG   ] Got command RPT from MCS: ref #324063
2018-10-30 18:50:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324063  12 58421 67820153 A  ERRORBŁff'
2018-10-30 18:50:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 18:50:39 [DEBUG   ] Got command RPT from MCS: ref #324064
2018-10-30 18:50:39 [DEBUG   ] summary = ERROR
2018-10-30 18:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324064  13 58421 67839914 A  ERRORERROR'
2018-10-30 18:50:39 [DEBUG   ] Got command RPT from MCS: ref #324065
2018-10-30 18:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324065  77 58421 67839914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:50:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:51:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 18:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 18:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 18:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:51:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:51:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:51:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:51:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:51:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:51:06 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-30 18:51:20 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-30 18:51:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 18:52:00 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-10-30 18:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 18:52:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:52:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:52:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:52:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:52:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:52:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:52:06 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-10-30 18:52:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:52:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:52:48 [DEBUG   ] Got command BAM from MCS: ref #324086
2018-10-30 18:52:48 [INFO    ] Finished processing BAM request
2018-10-30 18:52:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:52:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   324086   8 58421 67968033 A  ERROR'
2018-10-30 18:52:48 [DEBUG   ] Got command BAM from MCS: ref #324085
2018-10-30 18:52:48 [INFO    ] Finished processing BAM request
2018-10-30 18:52:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 18:52:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   324085   8 58421 67968037 A  ERROR'
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 18:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 18:52:48 [DEBUG   ] spawn_process: at 2018-10-30 18:52:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 18:53:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 18:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:53:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 18:53:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:53:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:53:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:53:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:53:06 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-10-30 18:53:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:53:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:54:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 18:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:54:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:54:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:54:07 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-30 18:54:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 18:54:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 18:55:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 18:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 18:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:55:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:55:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:55:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:55:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:55:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:55:06 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-10-30 18:55:19 [DEBUG   ] Got command RPT from MCS: ref #324093
2018-10-30 18:55:19 [DEBUG   ] summary = ERROR
2018-10-30 18:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324093  13 58421 68119433 A  ERRORERROR'
2018-10-30 18:55:19 [DEBUG   ] Got command RPT from MCS: ref #324094
2018-10-30 18:55:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324094  77 58421 68119637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:55:19 [DEBUG   ] Got command RPT from MCS: ref #324095
2018-10-30 18:55:19 [DEBUG   ] summary = ERROR
2018-10-30 18:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324095  13 58421 68119829 A  ERRORERROR'
2018-10-30 18:55:20 [DEBUG   ] Got command RPT from MCS: ref #324097
2018-10-30 18:55:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324097  77 58421 68120033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:55:20 [DEBUG   ] Got command RPT from MCS: ref #324099
2018-10-30 18:55:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 18:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324099  12 58421 68120237 A  ERRORBŁff'
2018-10-30 18:55:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 18:55:39 [DEBUG   ] Got command RPT from MCS: ref #324103
2018-10-30 18:55:39 [DEBUG   ] summary = ERROR
2018-10-30 18:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324103  13 58421 68139917 A  ERRORERROR'
2018-10-30 18:55:39 [DEBUG   ] Got command RPT from MCS: ref #324104
2018-10-30 18:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 18:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324104  77 58421 68139918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 18:55:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 18:56:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 18:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 18:56:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 18:56:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:56:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:56:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:56:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:56:06 [DEBUG   ] Finished updating board flags in 1.283 seconds
2018-10-30 18:56:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:56:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:57:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:57:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 18:57:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:57:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:57:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:57:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:57:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:57:06 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-10-30 18:57:12 [DEBUG   ] Got command STP from MCS: ref #324121
2018-10-30 18:57:12 [INFO    ] Finished processing BAM request
2018-10-30 18:57:12 [INFO    ] Shutdown the adder chain on beam #2
2018-10-30 18:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   324121   8 58421 68232025 A  ERROR'
2018-10-30 18:57:12 [DEBUG   ] Got command STP from MCS: ref #324120
2018-10-30 18:57:12 [INFO    ] Finished processing BAM request
2018-10-30 18:57:12 [INFO    ] Shutdown the adder chain on beam #3
2018-10-30 18:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   324120   8 58421 68232029 A  ERROR'
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 18:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 18:57:12 [DEBUG   ] spawn_process: at 2018-10-30 18:57:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 18:57:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:57:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:58:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:58:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:58:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:58:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:58:06 [WARNING ] (13, 1, 'bot')
2018-10-30 18:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:58:06 [DEBUG   ] Finished updating board flags in 1.094 seconds
2018-10-30 18:58:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:58:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 18:59:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 18:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 18:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 18:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 18:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:59:07 [WARNING ] (13, 1, 'bot')
2018-10-30 18:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 18:59:07 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-30 18:59:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 18:59:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 19:00:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:00:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:00:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:00:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:00:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:00:07 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-30 19:00:19 [DEBUG   ] Got command RPT from MCS: ref #324126
2018-10-30 19:00:19 [DEBUG   ] summary = ERROR
2018-10-30 19:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324126  13 58421 68419521 A  ERRORERROR'
2018-10-30 19:00:19 [DEBUG   ] Got command RPT from MCS: ref #324127
2018-10-30 19:00:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324127  77 58421 68419725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:00:19 [DEBUG   ] Got command RPT from MCS: ref #324128
2018-10-30 19:00:19 [DEBUG   ] summary = ERROR
2018-10-30 19:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324128  13 58421 68419917 A  ERRORERROR'
2018-10-30 19:00:20 [DEBUG   ] Got command RPT from MCS: ref #324129
2018-10-30 19:00:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324129  77 58421 68420121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:00:20 [DEBUG   ] Got command RPT from MCS: ref #324130
2018-10-30 19:00:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324130  12 58421 68420325 A  ERRORB'
2018-10-30 19:00:21 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-30 19:00:39 [DEBUG   ] Got command RPT from MCS: ref #324135
2018-10-30 19:00:39 [DEBUG   ] summary = ERROR
2018-10-30 19:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324135  13 58421 68439909 A  ERRORERROR'
2018-10-30 19:00:39 [DEBUG   ] Got command RPT from MCS: ref #324136
2018-10-30 19:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324136  77 58421 68439910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:00:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:01:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:01:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:01:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:01:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:01:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:01:07 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-10-30 19:01:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:01:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:02:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:02:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:02:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:02:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:02:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:02:07 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-10-30 19:02:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:02:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:03:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 19:03:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:03:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:03:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:03:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:03:07 [DEBUG   ] Finished updating board flags in 1.255 seconds
2018-10-30 19:03:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:03:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:04:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:04:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:04:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:04:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:04:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:04:07 [DEBUG   ] Finished updating board flags in 1.137 seconds
2018-10-30 19:04:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:04:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:05:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:05:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:05:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:05:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:05:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:05:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:05:07 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-10-30 19:05:19 [DEBUG   ] Got command RPT from MCS: ref #324158
2018-10-30 19:05:19 [DEBUG   ] summary = ERROR
2018-10-30 19:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324158  13 58421 68719601 A  ERRORERROR'
2018-10-30 19:05:19 [DEBUG   ] Got command RPT from MCS: ref #324159
2018-10-30 19:05:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324159  77 58421 68719805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:05:20 [DEBUG   ] Got command RPT from MCS: ref #324160
2018-10-30 19:05:20 [DEBUG   ] summary = ERROR
2018-10-30 19:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324160  13 58421 68720009 A  ERRORERROR'
2018-10-30 19:05:20 [DEBUG   ] Got command RPT from MCS: ref #324162
2018-10-30 19:05:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324162  77 58421 68720201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:05:20 [DEBUG   ] Got command RPT from MCS: ref #324163
2018-10-30 19:05:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324163  12 58421 68720405 A  ERRORB'
2018-10-30 19:05:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:05:39 [DEBUG   ] Got command RPT from MCS: ref #324168
2018-10-30 19:05:39 [DEBUG   ] summary = ERROR
2018-10-30 19:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324168  13 58421 68739921 A  ERRORERROR'
2018-10-30 19:05:39 [DEBUG   ] Got command RPT from MCS: ref #324169
2018-10-30 19:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324169  77 58421 68739922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:05:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:06:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:06:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:06:08 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-30 19:06:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:06:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:07:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:07:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:07:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:07:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:07:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:07:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:07:07 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-30 19:07:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:07:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:08:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:08:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:08:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:08:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:08:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:08:07 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-10-30 19:08:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:08:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:09:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:09:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:09:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:09:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:09:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:09:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:09:07 [DEBUG   ] Finished updating board flags in 1.310 seconds
2018-10-30 19:09:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 19:09:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 19:10:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-30 19:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:10:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:10:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:10:08 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-30 19:10:19 [DEBUG   ] Got command RPT from MCS: ref #324193
2018-10-30 19:10:19 [DEBUG   ] summary = ERROR
2018-10-30 19:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324193  13 58421 69019689 A  ERRORERROR'
2018-10-30 19:10:19 [DEBUG   ] Got command RPT from MCS: ref #324194
2018-10-30 19:10:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324194  77 58421 69019893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:10:20 [DEBUG   ] Got command RPT from MCS: ref #324195
2018-10-30 19:10:20 [DEBUG   ] summary = ERROR
2018-10-30 19:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324195  13 58421 69020085 A  ERRORERROR'
2018-10-30 19:10:20 [DEBUG   ] Got command RPT from MCS: ref #324196
2018-10-30 19:10:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324196  77 58421 69020289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:10:20 [DEBUG   ] Got command RPT from MCS: ref #324197
2018-10-30 19:10:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324197  12 58421 69020489 A  ERRORB'
2018-10-30 19:10:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 19:10:39 [DEBUG   ] Got command RPT from MCS: ref #324198
2018-10-30 19:10:39 [DEBUG   ] summary = ERROR
2018-10-30 19:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324198  13 58421 69039921 A  ERRORERROR'
2018-10-30 19:10:39 [DEBUG   ] Got command RPT from MCS: ref #324199
2018-10-30 19:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324199  77 58421 69039922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:10:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 19:11:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 19:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:11:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:11:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:11:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:11:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:11:07 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-10-30 19:11:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 19:11:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 19:12:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 19:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:12:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:12:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:12:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:12:07 [WARNING ] (13, 1, 'bot')
2018-10-30 19:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:12:07 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-10-30 19:12:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 19:12:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 19:13:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 19:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:13:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:13:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:13:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:13:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:13:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:13:08 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-30 19:13:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 19:13:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:14:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:14:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:14:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:14:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:14:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:14:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:14:08 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-10-30 19:14:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:14:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:15:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:15:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:15:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:15:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:15:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:15:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:15:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:15:08 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-10-30 19:15:19 [DEBUG   ] Got command RPT from MCS: ref #324221
2018-10-30 19:15:19 [DEBUG   ] summary = ERROR
2018-10-30 19:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324221  13 58421 69319774 A  ERRORERROR'
2018-10-30 19:15:19 [DEBUG   ] Got command RPT from MCS: ref #324222
2018-10-30 19:15:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324222  77 58421 69319977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:15:20 [DEBUG   ] Got command RPT from MCS: ref #324223
2018-10-30 19:15:20 [DEBUG   ] summary = ERROR
2018-10-30 19:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324223  13 58421 69320181 A  ERRORERROR'
2018-10-30 19:15:20 [DEBUG   ] Got command RPT from MCS: ref #324225
2018-10-30 19:15:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324225  77 58421 69320374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:15:20 [DEBUG   ] Got command RPT from MCS: ref #324226
2018-10-30 19:15:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324226  12 58421 69320578 A  ERRORB'
2018-10-30 19:15:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:15:39 [DEBUG   ] Got command RPT from MCS: ref #324235
2018-10-30 19:15:39 [DEBUG   ] summary = ERROR
2018-10-30 19:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324235  13 58421 69339921 A  ERRORERROR'
2018-10-30 19:15:39 [DEBUG   ] Got command RPT from MCS: ref #324236
2018-10-30 19:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324236  77 58421 69339922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:15:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:16:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:16:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:16:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:16:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:16:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:16:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:16:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:16:08 [DEBUG   ] Finished updating board flags in 1.236 seconds
2018-10-30 19:16:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:16:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:17:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:17:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:17:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:17:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:17:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:17:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:17:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:17:08 [DEBUG   ] Finished updating board flags in 1.155 seconds
2018-10-30 19:17:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:17:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:18:00 [DEBUG   ] Got command TBN from MCS: ref #324252
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-30 19:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   324252   8 58421 69480182 A  ERROR'
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540927081']
2018-10-30 19:18:00 [DEBUG   ] spawn_process: at 2018-10-30 19:18:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540927081']
2018-10-30 19:18:00 [INFO    ] Finished spawning TBN in 0.052 s
2018-10-30 19:18:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 19:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:18:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:18:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:18:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:18:08 [WARNING ] (13, 1, 'bot')
2018-10-30 19:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:18:08 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-30 19:18:22 [DEBUG   ] Finished updating ant stats in 1.066 seconds
2018-10-30 19:18:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:19:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 19:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:19:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:19:09 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-10-30 19:19:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 19:19:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 19:20:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 19:20:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:20:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:20:09 [DEBUG   ] Finished updating board flags in 1.955 seconds
2018-10-30 19:20:19 [DEBUG   ] Got command RPT from MCS: ref #324257
2018-10-30 19:20:19 [DEBUG   ] summary = ERROR
2018-10-30 19:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324257  13 58421 69619861 A  ERRORERROR'
2018-10-30 19:20:20 [DEBUG   ] Got command RPT from MCS: ref #324258
2018-10-30 19:20:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324258  77 58421 69620065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:20:20 [DEBUG   ] Got command RPT from MCS: ref #324259
2018-10-30 19:20:20 [DEBUG   ] summary = ERROR
2018-10-30 19:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324259  13 58421 69620269 A  ERRORERROR'
2018-10-30 19:20:20 [DEBUG   ] Got command RPT from MCS: ref #324260
2018-10-30 19:20:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324260  77 58421 69620461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:20:20 [DEBUG   ] Got command RPT from MCS: ref #324261
2018-10-30 19:20:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324261  12 58421 69620665 A  ERRORB'
2018-10-30 19:20:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 19:20:39 [DEBUG   ] Got command RPT from MCS: ref #324262
2018-10-30 19:20:39 [DEBUG   ] summary = ERROR
2018-10-30 19:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324262  13 58421 69639913 A  ERRORERROR'
2018-10-30 19:20:39 [DEBUG   ] Got command RPT from MCS: ref #324263
2018-10-30 19:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324263  77 58421 69639914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:20:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 19:21:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:21:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:21:09 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-10-30 19:21:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:21:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 19:22:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 19:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-30 19:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:22:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:22:09 [WARNING ] (25, 5, 'bot')
2018-10-30 19:22:09 [WARNING ] (25, 5, 'bot')
2018-10-30 19:22:09 [WARNING ] (25, 5, 'bot')
2018-10-30 19:22:09 [WARNING ] (25, 5, 'bot')
2018-10-30 19:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:22:09 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-30 19:22:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 19:22:43 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 19:23:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 19:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:23:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:23:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:23:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:23:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:23:09 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-30 19:23:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:23:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:24:03 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-30 19:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:24:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:24:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:24:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:24:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:24:09 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-30 19:24:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:24:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 19:25:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:25:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:25:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:25:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:25:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:25:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:25:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:25:09 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-30 19:25:19 [DEBUG   ] Got command RPT from MCS: ref #324289
2018-10-30 19:25:19 [DEBUG   ] summary = ERROR
2018-10-30 19:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324289  13 58421 69919949 A  ERRORERROR'
2018-10-30 19:25:20 [DEBUG   ] Got command RPT from MCS: ref #324290
2018-10-30 19:25:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324290  77 58421 69920153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:25:20 [DEBUG   ] Got command RPT from MCS: ref #324291
2018-10-30 19:25:20 [DEBUG   ] summary = ERROR
2018-10-30 19:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324291  13 58421 69920345 A  ERRORERROR'
2018-10-30 19:25:20 [DEBUG   ] Got command RPT from MCS: ref #324293
2018-10-30 19:25:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324293  77 58421 69920549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:25:20 [DEBUG   ] Got command RPT from MCS: ref #324294
2018-10-30 19:25:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324294  12 58421 69920753 A  ERRORB'
2018-10-30 19:25:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 19:25:39 [DEBUG   ] Got command RPT from MCS: ref #324299
2018-10-30 19:25:39 [DEBUG   ] summary = ERROR
2018-10-30 19:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324299  13 58421 69939922 A  ERRORERROR'
2018-10-30 19:25:39 [DEBUG   ] Got command RPT from MCS: ref #324300
2018-10-30 19:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324300  77 58421 69939922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:25:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 19:26:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:26:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:26:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:26:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:26:09 [WARNING ] (13, 1, 'bot')
2018-10-30 19:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:26:09 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-30 19:26:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:26:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:27:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:27:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:27:10 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-10-30 19:27:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:27:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:28:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:28:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:28:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:28:10 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-10-30 19:28:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:28:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:29:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:29:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:29:10 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-10-30 19:29:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 19:29:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 19:30:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 19:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 19:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:30:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:30:10 [DEBUG   ] Finished updating board flags in 1.922 seconds
2018-10-30 19:30:20 [DEBUG   ] Got command RPT from MCS: ref #324320
2018-10-30 19:30:20 [DEBUG   ] summary = ERROR
2018-10-30 19:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324320  13 58421 70220037 A  ERRORERROR'
2018-10-30 19:30:20 [DEBUG   ] Got command RPT from MCS: ref #324321
2018-10-30 19:30:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324321  77 58421 70220241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:30:20 [DEBUG   ] Got command RPT from MCS: ref #324322
2018-10-30 19:30:20 [DEBUG   ] summary = ERROR
2018-10-30 19:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324322  13 58421 70220433 A  ERRORERROR'
2018-10-30 19:30:20 [DEBUG   ] Got command RPT from MCS: ref #324323
2018-10-30 19:30:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324323  77 58421 70220638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:30:20 [DEBUG   ] Got command RPT from MCS: ref #324324
2018-10-30 19:30:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324324  12 58421 70220841 A  ERRORB'
2018-10-30 19:30:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 19:30:39 [DEBUG   ] Got command RPT from MCS: ref #324328
2018-10-30 19:30:39 [DEBUG   ] summary = ERROR
2018-10-30 19:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324328  13 58421 70239925 A  ERRORERROR'
2018-10-30 19:30:39 [DEBUG   ] Got command RPT from MCS: ref #324329
2018-10-30 19:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324329  77 58421 70239926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:30:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 19:31:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:31:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:31:10 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-30 19:31:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 19:31:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 19:32:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 19:32:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:32:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:32:10 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-30 19:32:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:32:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 19:33:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 19:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:33:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:33:10 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-30 19:33:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 19:33:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:34:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 19:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:34:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:34:10 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-30 19:34:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 19:34:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 19:35:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 19:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:35:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:35:10 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-30 19:35:20 [DEBUG   ] Got command RPT from MCS: ref #324352
2018-10-30 19:35:20 [DEBUG   ] summary = ERROR
2018-10-30 19:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324352  13 58421 70520121 A  ERRORERROR'
2018-10-30 19:35:20 [DEBUG   ] Got command RPT from MCS: ref #324353
2018-10-30 19:35:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324353  77 58421 70520325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:35:20 [DEBUG   ] Got command RPT from MCS: ref #324354
2018-10-30 19:35:20 [DEBUG   ] summary = ERROR
2018-10-30 19:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324354  13 58421 70520529 A  ERRORERROR'
2018-10-30 19:35:20 [DEBUG   ] Got command RPT from MCS: ref #324356
2018-10-30 19:35:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324356  77 58421 70520733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:35:20 [DEBUG   ] Got command RPT from MCS: ref #324358
2018-10-30 19:35:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324358  12 58421 70520925 A  ERRORB'
2018-10-30 19:35:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 19:35:39 [DEBUG   ] Got command RPT from MCS: ref #324362
2018-10-30 19:35:39 [DEBUG   ] summary = ERROR
2018-10-30 19:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324362  13 58421 70539921 A  ERRORERROR'
2018-10-30 19:35:39 [DEBUG   ] Got command RPT from MCS: ref #324363
2018-10-30 19:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324363  77 58421 70539922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:35:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 19:36:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 19:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:36:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:36:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:36:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:36:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:36:10 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-30 19:36:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 19:36:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 19:37:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-30 19:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:37:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:37:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:37:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:37:10 [WARNING ] (13, 1, 'bot')
2018-10-30 19:37:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:37:10 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-10-30 19:37:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:37:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:38:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 19:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:38:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:38:11 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-30 19:38:25 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-30 19:38:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:39:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:39:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:39:11 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-10-30 19:39:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-30 19:39:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 19:40:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:40:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:40:11 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-30 19:40:20 [DEBUG   ] Got command RPT from MCS: ref #324387
2018-10-30 19:40:20 [DEBUG   ] summary = ERROR
2018-10-30 19:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324387  13 58421 70820217 A  ERRORERROR'
2018-10-30 19:40:20 [DEBUG   ] Got command RPT from MCS: ref #324388
2018-10-30 19:40:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324388  77 58421 70820409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:40:20 [DEBUG   ] Got command RPT from MCS: ref #324389
2018-10-30 19:40:20 [DEBUG   ] summary = ERROR
2018-10-30 19:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324389  13 58421 70820613 A  ERRORERROR'
2018-10-30 19:40:20 [DEBUG   ] Got command RPT from MCS: ref #324390
2018-10-30 19:40:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324390  77 58421 70820817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:40:21 [DEBUG   ] Got command RPT from MCS: ref #324391
2018-10-30 19:40:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324391  12 58421 70821021 A  ERRORB'
2018-10-30 19:40:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 19:40:39 [DEBUG   ] Got command RPT from MCS: ref #324392
2018-10-30 19:40:39 [DEBUG   ] summary = ERROR
2018-10-30 19:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324392  13 58421 70839925 A  ERRORERROR'
2018-10-30 19:40:39 [DEBUG   ] Got command RPT from MCS: ref #324393
2018-10-30 19:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324393  77 58421 70839926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:40:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 19:41:06 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 19:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:41:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:41:11 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-30 19:41:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 19:41:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 19:42:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:42:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:42:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-30 19:42:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:42:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 19:43:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 19:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:43:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:43:11 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-10-30 19:43:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:43:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:44:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 19:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:44:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:44:11 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-10-30 19:44:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 19:44:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:45:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:45:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:45:11 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-30 19:45:20 [DEBUG   ] Got command RPT from MCS: ref #324415
2018-10-30 19:45:20 [DEBUG   ] summary = ERROR
2018-10-30 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324415  13 58421 71120301 A  ERRORERROR'
2018-10-30 19:45:20 [DEBUG   ] Got command RPT from MCS: ref #324416
2018-10-30 19:45:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324416  77 58421 71120494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:45:20 [DEBUG   ] Got command RPT from MCS: ref #324417
2018-10-30 19:45:20 [DEBUG   ] summary = ERROR
2018-10-30 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324417  13 58421 71120697 A  ERRORERROR'
2018-10-30 19:45:20 [DEBUG   ] Got command RPT from MCS: ref #324419
2018-10-30 19:45:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324419  77 58421 71120902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:45:21 [DEBUG   ] Got command RPT from MCS: ref #324420
2018-10-30 19:45:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324420  12 58421 71121105 A  ERRORB'
2018-10-30 19:45:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:45:39 [DEBUG   ] Got command RPT from MCS: ref #324427
2018-10-30 19:45:39 [DEBUG   ] summary = ERROR
2018-10-30 19:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324427  13 58421 71139922 A  ERRORERROR'
2018-10-30 19:45:39 [DEBUG   ] Got command RPT from MCS: ref #324428
2018-10-30 19:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324428  77 58421 71139922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:45:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 19:46:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 19:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:46:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:46:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:46:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:46:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:46:11 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-30 19:46:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 19:46:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 19:47:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 19:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:47:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:47:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:47:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:47:11 [WARNING ] (13, 1, 'bot')
2018-10-30 19:47:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:47:11 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-10-30 19:47:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 19:47:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 19:48:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 19:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:48:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:48:12 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-10-30 19:48:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:48:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 19:49:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 19:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:49:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:49:12 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-30 19:49:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 19:49:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:50:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 19:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:50:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:50:12 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-30 19:50:20 [DEBUG   ] Got command RPT from MCS: ref #324450
2018-10-30 19:50:20 [DEBUG   ] summary = ERROR
2018-10-30 19:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324450  13 58421 71420381 A  ERRORERROR'
2018-10-30 19:50:20 [DEBUG   ] Got command RPT from MCS: ref #324451
2018-10-30 19:50:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324451  77 58421 71420589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:50:20 [DEBUG   ] Got command RPT from MCS: ref #324452
2018-10-30 19:50:20 [DEBUG   ] summary = ERROR
2018-10-30 19:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324452  13 58421 71420781 A  ERRORERROR'
2018-10-30 19:50:20 [DEBUG   ] Got command RPT from MCS: ref #324453
2018-10-30 19:50:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324453  77 58421 71420985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:50:21 [DEBUG   ] Got command RPT from MCS: ref #324454
2018-10-30 19:50:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:50:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324454  12 58421 71421189 A  ERRORB'
2018-10-30 19:50:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 19:50:39 [DEBUG   ] Got command RPT from MCS: ref #324455
2018-10-30 19:50:39 [DEBUG   ] summary = ERROR
2018-10-30 19:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324455  13 58421 71439925 A  ERRORERROR'
2018-10-30 19:50:39 [DEBUG   ] Got command RPT from MCS: ref #324456
2018-10-30 19:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324456  77 58421 71439926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:50:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 19:51:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:51:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:51:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:51:12 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-30 19:51:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 19:51:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 19:52:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 19:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:52:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:52:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:52:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:52:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:52:12 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-30 19:52:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 19:52:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 19:53:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 19:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:53:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 19:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:53:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:53:12 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-30 19:53:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:53:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:54:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 19:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:54:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:54:12 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-30 19:54:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 19:54:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:55:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 19:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 19:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:55:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:55:12 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-30 19:55:20 [DEBUG   ] Got command RPT from MCS: ref #324482
2018-10-30 19:55:20 [DEBUG   ] summary = ERROR
2018-10-30 19:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324482  13 58421 71720473 A  ERRORERROR'
2018-10-30 19:55:20 [DEBUG   ] Got command RPT from MCS: ref #324483
2018-10-30 19:55:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324483  77 58421 71720665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:55:20 [DEBUG   ] Got command RPT from MCS: ref #324484
2018-10-30 19:55:20 [DEBUG   ] summary = ERROR
2018-10-30 19:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324484  13 58421 71720869 A  ERRORERROR'
2018-10-30 19:55:21 [DEBUG   ] Got command RPT from MCS: ref #324486
2018-10-30 19:55:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324486  77 58421 71721073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:55:21 [DEBUG   ] Got command RPT from MCS: ref #324487
2018-10-30 19:55:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 19:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324487  12 58421 71721265 A  ERRORB'
2018-10-30 19:55:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-30 19:55:39 [DEBUG   ] Got command RPT from MCS: ref #324492
2018-10-30 19:55:39 [DEBUG   ] summary = ERROR
2018-10-30 19:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324492  13 58421 71739921 A  ERRORERROR'
2018-10-30 19:55:39 [DEBUG   ] Got command RPT from MCS: ref #324493
2018-10-30 19:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 19:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324493  77 58421 71739922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 19:55:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 19:56:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 19:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:56:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:56:12 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-30 19:56:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 19:56:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 19:57:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 19:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 19:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:57:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:57:12 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-30 19:57:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 19:57:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 19:58:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 19:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:58:12 [WARNING ] (13, 1, 'bot')
2018-10-30 19:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:58:12 [DEBUG   ] Finished updating board flags in 1.318 seconds
2018-10-30 19:58:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 19:58:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 19:59:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 19:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 19:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 19:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 19:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 19:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 19:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 19:59:13 [WARNING ] (13, 1, 'bot')
2018-10-30 19:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 19:59:13 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-10-30 19:59:29 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-30 19:59:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 20:00:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:00:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:00:13 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-10-30 20:00:20 [DEBUG   ] Got command RPT from MCS: ref #324513
2018-10-30 20:00:20 [DEBUG   ] summary = ERROR
2018-10-30 20:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324513  13 58421 72020553 A  ERRORERROR'
2018-10-30 20:00:20 [DEBUG   ] Got command RPT from MCS: ref #324514
2018-10-30 20:00:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324514  77 58421 72020757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:00:20 [DEBUG   ] Got command RPT from MCS: ref #324515
2018-10-30 20:00:20 [DEBUG   ] summary = ERROR
2018-10-30 20:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324515  13 58421 72020961 A  ERRORERROR'
2018-10-30 20:00:21 [DEBUG   ] Got command RPT from MCS: ref #324516
2018-10-30 20:00:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324516  77 58421 72021153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:00:21 [DEBUG   ] Got command RPT from MCS: ref #324517
2018-10-30 20:00:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324517  12 58421 72021357 A  ERRORB'
2018-10-30 20:00:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 20:00:39 [DEBUG   ] Got command RPT from MCS: ref #324518
2018-10-30 20:00:39 [DEBUG   ] summary = ERROR
2018-10-30 20:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324518  13 58421 72039929 A  ERRORERROR'
2018-10-30 20:00:39 [DEBUG   ] Got command RPT from MCS: ref #324519
2018-10-30 20:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324519  77 58421 72039930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:00:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 20:01:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 20:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:01:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:01:13 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-30 20:01:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:01:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 20:02:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 20:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:02:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:02:13 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-30 20:02:30 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 20:02:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 20:03:09 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-30 20:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:03:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:03:13 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-30 20:03:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 20:03:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 20:04:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 20:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:04:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:04:13 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-30 20:04:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:04:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:05:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 20:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:05:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:05:13 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-30 20:05:20 [DEBUG   ] Got command RPT from MCS: ref #324545
2018-10-30 20:05:20 [DEBUG   ] summary = ERROR
2018-10-30 20:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324545  13 58421 72320641 A  ERRORERROR'
2018-10-30 20:05:20 [DEBUG   ] Got command RPT from MCS: ref #324546
2018-10-30 20:05:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324546  77 58421 72320845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:05:21 [DEBUG   ] Got command RPT from MCS: ref #324547
2018-10-30 20:05:21 [DEBUG   ] summary = ERROR
2018-10-30 20:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324547  13 58421 72321037 A  ERRORERROR'
2018-10-30 20:05:21 [DEBUG   ] Got command RPT from MCS: ref #324549
2018-10-30 20:05:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324549  77 58421 72321241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:05:21 [DEBUG   ] Got command RPT from MCS: ref #324550
2018-10-30 20:05:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324550  12 58421 72321445 A  ERRORB'
2018-10-30 20:05:30 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-10-30 20:05:39 [DEBUG   ] Got command RPT from MCS: ref #324555
2018-10-30 20:05:39 [DEBUG   ] summary = ERROR
2018-10-30 20:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324555  13 58421 72339929 A  ERRORERROR'
2018-10-30 20:05:39 [DEBUG   ] Got command RPT from MCS: ref #324556
2018-10-30 20:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324556  77 58421 72339930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:05:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 20:06:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:06:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:06:13 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-30 20:06:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 20:06:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 20:07:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 20:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 20:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:07:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:07:13 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-30 20:07:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:07:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 20:08:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 20:08:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:08:13 [WARNING ] (13, 1, 'bot')
2018-10-30 20:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:08:13 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-30 20:08:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 20:08:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 20:09:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 20:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:09:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:09:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:09:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:09:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:09:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:09:14 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-30 20:09:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:09:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:10:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 20:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:10:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:10:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:10:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:10:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:10:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:10:14 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-30 20:10:20 [DEBUG   ] Got command RPT from MCS: ref #324591
2018-10-30 20:10:20 [DEBUG   ] summary = ERROR
2018-10-30 20:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324591  13 58421 72620725 A  ERRORERROR'
2018-10-30 20:10:20 [DEBUG   ] Got command RPT from MCS: ref #324592
2018-10-30 20:10:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324592  77 58421 72620930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:10:21 [DEBUG   ] Got command RPT from MCS: ref #324593
2018-10-30 20:10:21 [DEBUG   ] summary = ERROR
2018-10-30 20:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324593  13 58421 72621133 A  ERRORERROR'
2018-10-30 20:10:21 [DEBUG   ] Got command RPT from MCS: ref #324594
2018-10-30 20:10:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324594  77 58421 72621325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:10:21 [DEBUG   ] Got command RPT from MCS: ref #324595
2018-10-30 20:10:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324595  12 58421 72621530 A  ERRORB'
2018-10-30 20:10:31 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2018-10-30 20:10:39 [DEBUG   ] Got command RPT from MCS: ref #324596
2018-10-30 20:10:39 [DEBUG   ] summary = ERROR
2018-10-30 20:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324596  13 58421 72639933 A  ERRORERROR'
2018-10-30 20:10:39 [DEBUG   ] Got command RPT from MCS: ref #324597
2018-10-30 20:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324597  77 58421 72639934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:10:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 20:11:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:11:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:11:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:11:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:11:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:11:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:11:14 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-30 20:11:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 20:11:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 20:12:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 20:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:12:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:12:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:12:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:12:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:12:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:12:14 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-30 20:12:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 20:12:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 20:13:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 20:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:13:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:13:14 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-30 20:13:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 20:13:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 20:14:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 20:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:14:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:14:14 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-30 20:14:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 20:14:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 20:15:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 20:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:15:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:15:14 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-30 20:15:20 [DEBUG   ] Got command RPT from MCS: ref #324619
2018-10-30 20:15:20 [DEBUG   ] summary = ERROR
2018-10-30 20:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324619  13 58421 72920813 A  ERRORERROR'
2018-10-30 20:15:21 [DEBUG   ] Got command RPT from MCS: ref #324620
2018-10-30 20:15:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324620  77 58421 72921005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:15:21 [DEBUG   ] Got command RPT from MCS: ref #324621
2018-10-30 20:15:21 [DEBUG   ] summary = ERROR
2018-10-30 20:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324621  13 58421 72921209 A  ERRORERROR'
2018-10-30 20:15:21 [DEBUG   ] Got command RPT from MCS: ref #324623
2018-10-30 20:15:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324623  77 58421 72921413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:15:21 [DEBUG   ] Got command RPT from MCS: ref #324624
2018-10-30 20:15:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324624  12 58421 72921617 A  ERRORB'
2018-10-30 20:15:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 20:15:39 [DEBUG   ] Got command RPT from MCS: ref #324629
2018-10-30 20:15:39 [DEBUG   ] summary = ERROR
2018-10-30 20:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324629  13 58421 72939933 A  ERRORERROR'
2018-10-30 20:15:39 [DEBUG   ] Got command RPT from MCS: ref #324630
2018-10-30 20:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324630  77 58421 72939934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:15:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:16:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 20:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:16:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:16:14 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-30 20:16:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 20:16:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 20:17:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 20:17:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:17:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:17:14 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-30 20:17:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:17:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 20:18:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 20:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:18:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:18:14 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-30 20:18:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 20:18:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 20:19:12 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-30 20:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:19:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:19:14 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-30 20:19:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 20:19:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 20:20:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 20:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 20:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:20:14 [WARNING ] (13, 1, 'bot')
2018-10-30 20:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:20:14 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-10-30 20:20:20 [DEBUG   ] Got command RPT from MCS: ref #324654
2018-10-30 20:20:20 [DEBUG   ] summary = ERROR
2018-10-30 20:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324654  13 58421 73220893 A  ERRORERROR'
2018-10-30 20:20:21 [DEBUG   ] Got command RPT from MCS: ref #324655
2018-10-30 20:20:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:20:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324655  77 58421 73221097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:20:21 [DEBUG   ] Got command RPT from MCS: ref #324656
2018-10-30 20:20:21 [DEBUG   ] summary = ERROR
2018-10-30 20:20:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324656  13 58421 73221301 A  ERRORERROR'
2018-10-30 20:20:21 [DEBUG   ] Got command RPT from MCS: ref #324657
2018-10-30 20:20:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:20:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324657  77 58421 73221493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:20:21 [DEBUG   ] Got command RPT from MCS: ref #324658
2018-10-30 20:20:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:20:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324658  12 58421 73221697 A  ERRORB'
2018-10-30 20:20:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 20:20:39 [DEBUG   ] Got command RPT from MCS: ref #324659
2018-10-30 20:20:39 [DEBUG   ] summary = ERROR
2018-10-30 20:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324659  13 58421 73239937 A  ERRORERROR'
2018-10-30 20:20:39 [DEBUG   ] Got command RPT from MCS: ref #324660
2018-10-30 20:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324660  77 58421 73239938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:20:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:21:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 20:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:21:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:21:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:21:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:21:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:21:15 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-10-30 20:21:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 20:21:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 20:22:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 20:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:22:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:22:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:22:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:22:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:22:15 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-30 20:22:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 20:22:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-30 20:23:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 20:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:23:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:23:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:23:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:23:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:23:15 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-30 20:23:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 20:23:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 20:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:24:14 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2018-10-30 20:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:24:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:24:15 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-30 20:24:34 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-10-30 20:24:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 20:25:14 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-30 20:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:25:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:25:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:25:15 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-30 20:25:20 [DEBUG   ] Got command RPT from MCS: ref #324686
2018-10-30 20:25:20 [DEBUG   ] summary = ERROR
2018-10-30 20:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324686  13 58421 73520981 A  ERRORERROR'
2018-10-30 20:25:21 [DEBUG   ] Got command RPT from MCS: ref #324687
2018-10-30 20:25:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324687  77 58421 73521185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:25:21 [DEBUG   ] Got command RPT from MCS: ref #324688
2018-10-30 20:25:21 [DEBUG   ] summary = ERROR
2018-10-30 20:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324688  13 58421 73521377 A  ERRORERROR'
2018-10-30 20:25:21 [DEBUG   ] Got command RPT from MCS: ref #324690
2018-10-30 20:25:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324690  77 58421 73521581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:25:21 [DEBUG   ] Got command RPT from MCS: ref #324692
2018-10-30 20:25:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324692  12 58421 73521785 A  ERRORB'
2018-10-30 20:25:34 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-10-30 20:25:39 [DEBUG   ] Got command RPT from MCS: ref #324696
2018-10-30 20:25:39 [DEBUG   ] summary = ERROR
2018-10-30 20:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324696  13 58421 73539933 A  ERRORERROR'
2018-10-30 20:25:39 [DEBUG   ] Got command RPT from MCS: ref #324697
2018-10-30 20:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324697  77 58421 73539934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:25:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 20:26:14 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2018-10-30 20:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 20:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:26:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:26:15 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-30 20:26:34 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2018-10-30 20:26:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:27:14 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2018-10-30 20:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:27:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:27:15 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-30 20:27:34 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-10-30 20:27:54 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 20:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:28:15 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2018-10-30 20:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:28:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:28:15 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-10-30 20:28:35 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2018-10-30 20:28:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 20:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:29:15 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-10-30 20:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:29:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:29:15 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-30 20:29:35 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2018-10-30 20:29:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 20:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:30:15 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-10-30 20:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:30:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:30:15 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-10-30 20:30:21 [DEBUG   ] Got command RPT from MCS: ref #324717
2018-10-30 20:30:21 [DEBUG   ] summary = ERROR
2018-10-30 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324717  13 58421 73821061 A  ERRORERROR'
2018-10-30 20:30:21 [DEBUG   ] Got command RPT from MCS: ref #324718
2018-10-30 20:30:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324718  77 58421 73821265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:30:21 [DEBUG   ] Got command RPT from MCS: ref #324719
2018-10-30 20:30:21 [DEBUG   ] summary = ERROR
2018-10-30 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324719  13 58421 73821469 A  ERRORERROR'
2018-10-30 20:30:21 [DEBUG   ] Got command RPT from MCS: ref #324720
2018-10-30 20:30:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324720  77 58421 73821673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:30:21 [DEBUG   ] Got command RPT from MCS: ref #324721
2018-10-30 20:30:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324721  12 58421 73821865 A  ERRORB'
2018-10-30 20:30:35 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-30 20:30:39 [DEBUG   ] Got command RPT from MCS: ref #324722
2018-10-30 20:30:39 [DEBUG   ] summary = ERROR
2018-10-30 20:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324722  13 58421 73839937 A  ERRORERROR'
2018-10-30 20:30:39 [DEBUG   ] Got command RPT from MCS: ref #324723
2018-10-30 20:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324723  77 58421 73839938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:30:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 20:31:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:31:15 [WARNING ] (13, 1, 'bot')
2018-10-30 20:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:31:15 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-10-30 20:31:16 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 20:31:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 20:31:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 20:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:32:16 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-10-30 20:32:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:32:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:32:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:32:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:32:16 [DEBUG   ] Finished updating board flags in 2.241 seconds
2018-10-30 20:32:36 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-30 20:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:33:16 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2018-10-30 20:33:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:33:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:33:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:33:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:33:16 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-10-30 20:33:36 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2018-10-30 20:33:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 20:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:34:16 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-10-30 20:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:34:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:34:16 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-30 20:34:36 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-30 20:34:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-30 20:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:35:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:35:16 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-30 20:35:17 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-30 20:35:21 [DEBUG   ] Got command RPT from MCS: ref #324749
2018-10-30 20:35:21 [DEBUG   ] summary = ERROR
2018-10-30 20:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324749  13 58421 74121149 A  ERRORERROR'
2018-10-30 20:35:21 [DEBUG   ] Got command RPT from MCS: ref #324750
2018-10-30 20:35:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324750  77 58421 74121353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:35:21 [DEBUG   ] Got command RPT from MCS: ref #324751
2018-10-30 20:35:21 [DEBUG   ] summary = ERROR
2018-10-30 20:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324751  13 58421 74121557 A  ERRORERROR'
2018-10-30 20:35:21 [DEBUG   ] Got command RPT from MCS: ref #324753
2018-10-30 20:35:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324753  77 58421 74121749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:35:21 [DEBUG   ] Got command RPT from MCS: ref #324754
2018-10-30 20:35:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324754  12 58421 74121953 A  ERRORB'
2018-10-30 20:35:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 20:35:39 [DEBUG   ] Got command RPT from MCS: ref #324759
2018-10-30 20:35:39 [DEBUG   ] summary = ERROR
2018-10-30 20:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324759  13 58421 74139941 A  ERRORERROR'
2018-10-30 20:35:39 [DEBUG   ] Got command RPT from MCS: ref #324760
2018-10-30 20:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324760  77 58421 74139942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:35:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 20:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 20:36:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:36:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:36:16 [DEBUG   ] Finished updating board flags in 1.923 seconds
2018-10-30 20:36:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 20:36:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:36:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 20:37:11 [DEBUG   ] Got command TBW from MCS: ref #324781
2018-10-30 20:37:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-30 20:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   324781   8 58421 74231361 A  ERROR'
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-30 20:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-30 20:37:14 [DEBUG   ] spawn_process: at 2018-10-30 20:37:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-30 20:37:14 [INFO    ] Finished spawning TBW
2018-10-30 20:37:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 20:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:37:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:37:16 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-10-30 20:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:38:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:38:16 [DEBUG   ] Finished updating board flags in 1.728 seconds
2018-10-30 20:39:02 [INFO    ] __waitForTBW - TBW finished in 107.963 s
2018-10-30 20:39:03 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-10-30 20:39:03 [INFO    ] Started antennas statistics background thread
2018-10-30 20:39:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540931945']
2018-10-30 20:39:03 [DEBUG   ] spawn_process: at 2018-10-30 20:39:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540931945']
2018-10-30 20:39:03 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-30 20:39:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 20:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:39:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:39:16 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-30 20:39:23 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-10-30 20:39:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 20:40:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 20:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:40:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:40:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:40:16 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-30 20:40:21 [DEBUG   ] Got command RPT from MCS: ref #324793
2018-10-30 20:40:21 [DEBUG   ] summary = ERROR
2018-10-30 20:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324793  13 58421 74421245 A  ERRORERROR'
2018-10-30 20:40:21 [DEBUG   ] Got command RPT from MCS: ref #324794
2018-10-30 20:40:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324794  77 58421 74421437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:40:21 [DEBUG   ] Got command RPT from MCS: ref #324795
2018-10-30 20:40:21 [DEBUG   ] summary = ERROR
2018-10-30 20:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324795  13 58421 74421641 A  ERRORERROR'
2018-10-30 20:40:21 [DEBUG   ] Got command RPT from MCS: ref #324796
2018-10-30 20:40:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324796  77 58421 74421845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:40:22 [DEBUG   ] Got command RPT from MCS: ref #324797
2018-10-30 20:40:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324797  12 58421 74422037 A  ERRORB'
2018-10-30 20:40:23 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 20:40:39 [DEBUG   ] Got command RPT from MCS: ref #324798
2018-10-30 20:40:39 [DEBUG   ] summary = ERROR
2018-10-30 20:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324798  13 58421 74439933 A  ERRORERROR'
2018-10-30 20:40:39 [DEBUG   ] Got command RPT from MCS: ref #324799
2018-10-30 20:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324799  77 58421 74439934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:40:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 20:41:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 20:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:41:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:41:16 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-30 20:41:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 20:41:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:42:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:42:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:42:16 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-10-30 20:42:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 20:42:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 20:43:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 20:43:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:43:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:43:16 [DEBUG   ] Finished updating board flags in 1.638 seconds
2018-10-30 20:43:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 20:43:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 20:44:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 20:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 20:44:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 20:44:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:44:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:44:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:44:16 [WARNING ] (13, 1, 'bot')
2018-10-30 20:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:44:16 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-10-30 20:44:24 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 20:44:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 20:45:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 20:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:45:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:45:17 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-30 20:45:21 [DEBUG   ] Got command RPT from MCS: ref #324821
2018-10-30 20:45:21 [DEBUG   ] summary = ERROR
2018-10-30 20:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324821  13 58421 74721317 A  ERRORERROR'
2018-10-30 20:45:21 [DEBUG   ] Got command RPT from MCS: ref #324822
2018-10-30 20:45:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324822  77 58421 74721521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:45:21 [DEBUG   ] Got command RPT from MCS: ref #324823
2018-10-30 20:45:21 [DEBUG   ] summary = ERROR
2018-10-30 20:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324823  13 58421 74721725 A  ERRORERROR'
2018-10-30 20:45:21 [DEBUG   ] Got command RPT from MCS: ref #324825
2018-10-30 20:45:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324825  77 58421 74721929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:45:22 [DEBUG   ] Got command RPT from MCS: ref #324827
2018-10-30 20:45:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324827  12 58421 74722121 A  ERRORB'
2018-10-30 20:45:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:45:39 [DEBUG   ] Got command RPT from MCS: ref #324831
2018-10-30 20:45:39 [DEBUG   ] summary = ERROR
2018-10-30 20:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324831  13 58421 74739941 A  ERRORERROR'
2018-10-30 20:45:39 [DEBUG   ] Got command RPT from MCS: ref #324832
2018-10-30 20:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324832  77 58421 74739942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:45:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:46:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 20:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:46:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:46:17 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-30 20:46:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 20:46:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 20:47:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 20:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:47:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:47:17 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-30 20:47:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 20:47:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 20:48:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:48:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:48:17 [DEBUG   ] Finished updating board flags in 2.330 seconds
2018-10-30 20:48:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 20:48:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 20:49:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 20:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:49:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:49:17 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-10-30 20:49:26 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 20:49:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 20:50:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-30 20:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:50:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:50:17 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-30 20:50:21 [DEBUG   ] Got command RPT from MCS: ref #324856
2018-10-30 20:50:21 [DEBUG   ] summary = ERROR
2018-10-30 20:50:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324856  13 58421 75021409 A  ERRORERROR'
2018-10-30 20:50:21 [DEBUG   ] Got command RPT from MCS: ref #324857
2018-10-30 20:50:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:50:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324857  77 58421 75021613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:50:21 [DEBUG   ] Got command RPT from MCS: ref #324858
2018-10-30 20:50:21 [DEBUG   ] summary = ERROR
2018-10-30 20:50:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324858  13 58421 75021805 A  ERRORERROR'
2018-10-30 20:50:22 [DEBUG   ] Got command RPT from MCS: ref #324859
2018-10-30 20:50:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:50:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324859  77 58421 75022009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:50:22 [DEBUG   ] Got command RPT from MCS: ref #324860
2018-10-30 20:50:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:50:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324860  12 58421 75022213 A  ERRORB'
2018-10-30 20:50:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 20:50:39 [DEBUG   ] Got command RPT from MCS: ref #324861
2018-10-30 20:50:39 [DEBUG   ] summary = ERROR
2018-10-30 20:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324861  13 58421 75039937 A  ERRORERROR'
2018-10-30 20:50:39 [DEBUG   ] Got command RPT from MCS: ref #324862
2018-10-30 20:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324862  77 58421 75039938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:50:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 20:51:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 20:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:51:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:51:17 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-30 20:51:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:51:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:52:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 20:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:52:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:52:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:52:17 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-30 20:52:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 20:52:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 20:53:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 20:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:53:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:53:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:53:17 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-30 20:53:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 20:53:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 20:54:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 20:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:54:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:54:17 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-30 20:54:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:54:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 20:55:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 20:55:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:55:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:55:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:55:17 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-30 20:55:21 [DEBUG   ] Got command RPT from MCS: ref #324888
2018-10-30 20:55:21 [DEBUG   ] summary = ERROR
2018-10-30 20:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324888  13 58421 75321497 A  ERRORERROR'
2018-10-30 20:55:21 [DEBUG   ] Got command RPT from MCS: ref #324889
2018-10-30 20:55:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324889  77 58421 75321701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:55:21 [DEBUG   ] Got command RPT from MCS: ref #324890
2018-10-30 20:55:21 [DEBUG   ] summary = ERROR
2018-10-30 20:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324890  13 58421 75321893 A  ERRORERROR'
2018-10-30 20:55:22 [DEBUG   ] Got command RPT from MCS: ref #324892
2018-10-30 20:55:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324892  77 58421 75322097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:55:22 [DEBUG   ] Got command RPT from MCS: ref #324894
2018-10-30 20:55:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 20:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324894  12 58421 75322301 A  ERRORB'
2018-10-30 20:55:27 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 20:55:39 [DEBUG   ] Got command RPT from MCS: ref #324898
2018-10-30 20:55:39 [DEBUG   ] summary = ERROR
2018-10-30 20:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324898  13 58421 75339941 A  ERRORERROR'
2018-10-30 20:55:39 [DEBUG   ] Got command RPT from MCS: ref #324899
2018-10-30 20:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 20:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324899  77 58421 75339942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 20:55:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 20:56:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 20:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:56:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:56:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:56:17 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-30 20:56:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 20:56:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 20:57:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 20:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:57:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:57:17 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-30 20:57:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 20:57:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 20:58:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 20:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:58:17 [WARNING ] (13, 1, 'bot')
2018-10-30 20:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:58:17 [DEBUG   ] Finished updating board flags in 1.345 seconds
2018-10-30 20:58:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-30 20:58:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 20:59:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 20:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 20:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 20:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 20:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 20:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 20:59:18 [WARNING ] (13, 1, 'bot')
2018-10-30 20:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 20:59:18 [DEBUG   ] Finished updating board flags in 2.081 seconds
2018-10-30 20:59:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 20:59:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 21:00:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 21:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 21:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:00:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:00:18 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-30 21:00:21 [DEBUG   ] Got command RPT from MCS: ref #324919
2018-10-30 21:00:21 [DEBUG   ] summary = ERROR
2018-10-30 21:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324919  13 58421 75621581 A  ERRORERROR'
2018-10-30 21:00:21 [DEBUG   ] Got command RPT from MCS: ref #324920
2018-10-30 21:00:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324920  77 58421 75621785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:00:21 [DEBUG   ] Got command RPT from MCS: ref #324921
2018-10-30 21:00:21 [DEBUG   ] summary = ERROR
2018-10-30 21:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324921  13 58421 75621977 A  ERRORERROR'
2018-10-30 21:00:22 [DEBUG   ] Got command RPT from MCS: ref #324922
2018-10-30 21:00:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324922  77 58421 75622181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:00:22 [DEBUG   ] Got command RPT from MCS: ref #324923
2018-10-30 21:00:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324923  12 58421 75622385 A  ERRORB'
2018-10-30 21:00:28 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 21:00:39 [DEBUG   ] Got command RPT from MCS: ref #324924
2018-10-30 21:00:39 [DEBUG   ] summary = ERROR
2018-10-30 21:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324924  13 58421 75639941 A  ERRORERROR'
2018-10-30 21:00:39 [DEBUG   ] Got command RPT from MCS: ref #324925
2018-10-30 21:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324925  77 58421 75639942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:00:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:01:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 21:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 21:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:01:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:01:18 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-30 21:01:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:01:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:02:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 21:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 21:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 21:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:02:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:02:18 [DEBUG   ] Finished updating board flags in 1.925 seconds
2018-10-30 21:02:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 21:02:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:03:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:03:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:03:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:03:18 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-30 21:03:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 21:03:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 21:04:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 21:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:04:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:04:18 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-30 21:04:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 21:04:48 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-30 21:05:08 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-30 21:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 21:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:05:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:05:18 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-30 21:05:21 [DEBUG   ] Got command RPT from MCS: ref #324951
2018-10-30 21:05:21 [DEBUG   ] summary = ERROR
2018-10-30 21:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324951  13 58421 75921669 A  ERRORERROR'
2018-10-30 21:05:21 [DEBUG   ] Got command RPT from MCS: ref #324952
2018-10-30 21:05:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324952  77 58421 75921861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:05:22 [DEBUG   ] Got command RPT from MCS: ref #324953
2018-10-30 21:05:22 [DEBUG   ] summary = ERROR
2018-10-30 21:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324953  13 58421 75922065 A  ERRORERROR'
2018-10-30 21:05:22 [DEBUG   ] Got command RPT from MCS: ref #324955
2018-10-30 21:05:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324955  77 58421 75922269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:05:22 [DEBUG   ] Got command RPT from MCS: ref #324956
2018-10-30 21:05:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324956  12 58421 75922473 A  ERRORB'
2018-10-30 21:05:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 21:05:39 [DEBUG   ] Got command RPT from MCS: ref #324961
2018-10-30 21:05:39 [DEBUG   ] summary = ERROR
2018-10-30 21:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324961  13 58421 75939945 A  ERRORERROR'
2018-10-30 21:05:39 [DEBUG   ] Got command RPT from MCS: ref #324962
2018-10-30 21:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324962  77 58421 75939946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:05:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 21:06:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 21:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:06:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:06:18 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-30 21:06:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:06:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:07:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-30 21:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:07:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:07:18 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-30 21:07:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 21:07:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:08:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:08:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:08:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:08:18 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-30 21:08:29 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-30 21:08:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 21:09:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 21:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 21:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:09:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:09:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:09:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:09:18 [WARNING ] (13, 1, 'bot')
2018-10-30 21:09:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:09:18 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-30 21:09:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 21:09:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 21:10:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:10:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:10:19 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-10-30 21:10:21 [DEBUG   ] Got command RPT from MCS: ref #324986
2018-10-30 21:10:21 [DEBUG   ] summary = ERROR
2018-10-30 21:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324986  13 58421 76221749 A  ERRORERROR'
2018-10-30 21:10:21 [DEBUG   ] Got command RPT from MCS: ref #324987
2018-10-30 21:10:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324987  77 58421 76221953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:10:22 [DEBUG   ] Got command RPT from MCS: ref #324988
2018-10-30 21:10:22 [DEBUG   ] summary = ERROR
2018-10-30 21:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324988  13 58421 76222157 A  ERRORERROR'
2018-10-30 21:10:22 [DEBUG   ] Got command RPT from MCS: ref #324989
2018-10-30 21:10:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324989  77 58421 76222349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:10:22 [DEBUG   ] Got command RPT from MCS: ref #324990
2018-10-30 21:10:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324990  12 58421 76222553 A  ERRORB'
2018-10-30 21:10:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-30 21:10:39 [DEBUG   ] Got command RPT from MCS: ref #324991
2018-10-30 21:10:39 [DEBUG   ] summary = ERROR
2018-10-30 21:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324991  13 58421 76239945 A  ERRORERROR'
2018-10-30 21:10:39 [DEBUG   ] Got command RPT from MCS: ref #324992
2018-10-30 21:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   324992  77 58421 76239946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:10:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 21:11:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 21:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:11:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:11:19 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-30 21:11:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 21:11:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 21:12:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 21:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:12:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:12:19 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-30 21:12:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 21:12:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:13:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:13:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:13:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:13:19 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-30 21:13:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 21:13:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 21:14:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 21:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:14:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:14:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:14:19 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-30 21:14:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 21:14:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 21:15:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 21:15:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 21:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:15:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 21:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:15:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:15:19 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-30 21:15:21 [DEBUG   ] Got command RPT from MCS: ref #325014
2018-10-30 21:15:21 [DEBUG   ] summary = ERROR
2018-10-30 21:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325014  13 58421 76521833 A  ERRORERROR'
2018-10-30 21:15:22 [DEBUG   ] Got command RPT from MCS: ref #325015
2018-10-30 21:15:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:15:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325015  77 58421 76522037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:15:22 [DEBUG   ] Got command RPT from MCS: ref #325016
2018-10-30 21:15:22 [DEBUG   ] summary = ERROR
2018-10-30 21:15:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325016  13 58421 76522241 A  ERRORERROR'
2018-10-30 21:15:22 [DEBUG   ] Got command RPT from MCS: ref #325018
2018-10-30 21:15:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:15:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325018  77 58421 76522433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:15:22 [DEBUG   ] Got command RPT from MCS: ref #325019
2018-10-30 21:15:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:15:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325019  12 58421 76522637 A  ERRORB'
2018-10-30 21:15:31 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 21:15:39 [DEBUG   ] Got command RPT from MCS: ref #325024
2018-10-30 21:15:39 [DEBUG   ] summary = ERROR
2018-10-30 21:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325024  13 58421 76539941 A  ERRORERROR'
2018-10-30 21:15:39 [DEBUG   ] Got command RPT from MCS: ref #325025
2018-10-30 21:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325025  77 58421 76539942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:15:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 21:16:11 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 21:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:16:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:16:19 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-30 21:16:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 21:16:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 21:17:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 21:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:17:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:17:19 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-30 21:17:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:17:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:18:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 21:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:18:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:18:19 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-30 21:18:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 21:18:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:19:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:19:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:19:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:19:19 [WARNING ] (13, 1, 'bot')
2018-10-30 21:19:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:19:19 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-10-30 21:19:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:19:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:20:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 21:20:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:20:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:20:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:20:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:20:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:20:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:20:20 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-10-30 21:20:21 [DEBUG   ] Got command RPT from MCS: ref #325049
2018-10-30 21:20:21 [DEBUG   ] summary = ERROR
2018-10-30 21:20:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325049  13 58421 76821929 A  ERRORERROR'
2018-10-30 21:20:22 [DEBUG   ] Got command RPT from MCS: ref #325050
2018-10-30 21:20:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325050  77 58421 76822121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:20:22 [DEBUG   ] Got command RPT from MCS: ref #325051
2018-10-30 21:20:22 [DEBUG   ] summary = ERROR
2018-10-30 21:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325051  13 58421 76822325 A  ERRORERROR'
2018-10-30 21:20:22 [DEBUG   ] Got command RPT from MCS: ref #325052
2018-10-30 21:20:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325052  77 58421 76822529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:20:22 [DEBUG   ] Got command RPT from MCS: ref #325053
2018-10-30 21:20:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325053  12 58421 76822721 A  ERRORB'
2018-10-30 21:20:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:20:39 [DEBUG   ] Got command RPT from MCS: ref #325054
2018-10-30 21:20:39 [DEBUG   ] summary = ERROR
2018-10-30 21:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325054  13 58421 76839953 A  ERRORERROR'
2018-10-30 21:20:39 [DEBUG   ] Got command RPT from MCS: ref #325055
2018-10-30 21:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325055  77 58421 76839954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:20:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:21:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:21:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:21:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:21:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:21:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:21:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:21:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:21:20 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-10-30 21:21:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:21:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:22:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 21:22:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:22:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:22:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:22:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:22:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:22:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:22:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:22:20 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-30 21:22:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 21:22:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 21:23:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 21:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:23:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:23:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:23:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:23:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:23:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:23:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:23:20 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-10-30 21:23:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 21:23:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 21:24:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 21:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:24:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:24:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:24:20 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-30 21:24:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 21:24:51 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-10-30 21:25:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 21:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:25:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:25:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:25:20 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-10-30 21:25:22 [DEBUG   ] Got command RPT from MCS: ref #325081
2018-10-30 21:25:22 [DEBUG   ] summary = ERROR
2018-10-30 21:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325081  13 58421 77122013 A  ERRORERROR'
2018-10-30 21:25:22 [DEBUG   ] Got command RPT from MCS: ref #325082
2018-10-30 21:25:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325082  77 58421 77122205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:25:22 [DEBUG   ] Got command RPT from MCS: ref #325083
2018-10-30 21:25:22 [DEBUG   ] summary = ERROR
2018-10-30 21:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325083  13 58421 77122409 A  ERRORERROR'
2018-10-30 21:25:22 [DEBUG   ] Got command RPT from MCS: ref #325085
2018-10-30 21:25:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325085  77 58421 77122613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:25:22 [DEBUG   ] Got command RPT from MCS: ref #325086
2018-10-30 21:25:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325086  12 58421 77122805 A  ERRORB'
2018-10-30 21:25:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 21:25:39 [DEBUG   ] Got command RPT from MCS: ref #325091
2018-10-30 21:25:39 [DEBUG   ] summary = ERROR
2018-10-30 21:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325091  13 58421 77139953 A  ERRORERROR'
2018-10-30 21:25:39 [DEBUG   ] Got command RPT from MCS: ref #325092
2018-10-30 21:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325092  77 58421 77139954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:25:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 21:26:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 21:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:26:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:26:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:26:20 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-30 21:26:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:26:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:27:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:27:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:27:20 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-30 21:27:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 21:27:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:28:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:28:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:28:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:28:20 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-30 21:28:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:28:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 21:29:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 21:29:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:29:20 [WARNING ] (13, 1, 'bot')
2018-10-30 21:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:29:20 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-30 21:29:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 21:29:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 21:30:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 21:30:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:30:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:30:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:30:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:30:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:30:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:30:21 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-10-30 21:30:22 [DEBUG   ] Got command RPT from MCS: ref #325112
2018-10-30 21:30:22 [DEBUG   ] summary = ERROR
2018-10-30 21:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325112  13 58421 77422089 A  ERRORERROR'
2018-10-30 21:30:22 [DEBUG   ] Got command RPT from MCS: ref #325113
2018-10-30 21:30:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325113  77 58421 77422293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:30:22 [DEBUG   ] Got command RPT from MCS: ref #325114
2018-10-30 21:30:22 [DEBUG   ] summary = ERROR
2018-10-30 21:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325114  13 58421 77422497 A  ERRORERROR'
2018-10-30 21:30:22 [DEBUG   ] Got command RPT from MCS: ref #325115
2018-10-30 21:30:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325115  77 58421 77422701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:30:22 [DEBUG   ] Got command RPT from MCS: ref #325116
2018-10-30 21:30:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325116  12 58421 77422894 A  ERRORB'
2018-10-30 21:30:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 21:30:39 [DEBUG   ] Got command RPT from MCS: ref #325117
2018-10-30 21:30:39 [DEBUG   ] summary = ERROR
2018-10-30 21:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325117  13 58421 77439949 A  ERRORERROR'
2018-10-30 21:30:39 [DEBUG   ] Got command RPT from MCS: ref #325118
2018-10-30 21:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325118  77 58421 77439950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:30:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 21:31:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 21:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:31:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:31:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:31:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:31:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:31:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:31:21 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-30 21:31:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 21:31:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:32:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 21:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:32:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:32:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:32:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:32:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:32:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:32:21 [DEBUG   ] Finished updating board flags in 2.130 seconds
2018-10-30 21:32:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 21:32:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:33:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:33:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:33:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:33:21 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-30 21:33:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 21:33:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 21:34:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:34:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:34:21 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-30 21:34:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:34:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:35:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-30 21:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:35:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:35:21 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-30 21:35:22 [DEBUG   ] Got command RPT from MCS: ref #325144
2018-10-30 21:35:22 [DEBUG   ] summary = ERROR
2018-10-30 21:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325144  13 58421 77722177 A  ERRORERROR'
2018-10-30 21:35:22 [DEBUG   ] Got command RPT from MCS: ref #325145
2018-10-30 21:35:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325145  77 58421 77722381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:35:22 [DEBUG   ] Got command RPT from MCS: ref #325146
2018-10-30 21:35:22 [DEBUG   ] summary = ERROR
2018-10-30 21:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325146  13 58421 77722585 A  ERRORERROR'
2018-10-30 21:35:22 [DEBUG   ] Got command RPT from MCS: ref #325148
2018-10-30 21:35:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325148  77 58421 77722777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:35:22 [DEBUG   ] Got command RPT from MCS: ref #325149
2018-10-30 21:35:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325149  12 58421 77722981 A  ERRORB'
2018-10-30 21:35:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 21:35:39 [DEBUG   ] Got command RPT from MCS: ref #325154
2018-10-30 21:35:39 [DEBUG   ] summary = ERROR
2018-10-30 21:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325154  13 58421 77739945 A  ERRORERROR'
2018-10-30 21:35:39 [DEBUG   ] Got command RPT from MCS: ref #325155
2018-10-30 21:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325155  77 58421 77739946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:35:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 21:36:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 21:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:36:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:36:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:36:21 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-30 21:36:33 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-10-30 21:36:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 21:37:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 21:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:37:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:37:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:37:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:37:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:37:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:37:21 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-30 21:37:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 21:37:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 21:38:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:38:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:38:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:38:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:38:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:38:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:38:21 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-30 21:38:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 21:38:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 21:39:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:39:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:39:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:39:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:39:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:39:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:39:21 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-30 21:39:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 21:39:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 21:40:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 21:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:40:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 21:40:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:40:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:40:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:40:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:40:21 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-30 21:40:22 [DEBUG   ] Got command RPT from MCS: ref #325179
2018-10-30 21:40:22 [DEBUG   ] summary = ERROR
2018-10-30 21:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325179  13 58421 78022261 A  ERRORERROR'
2018-10-30 21:40:22 [DEBUG   ] Got command RPT from MCS: ref #325180
2018-10-30 21:40:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325180  77 58421 78022465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:40:22 [DEBUG   ] Got command RPT from MCS: ref #325181
2018-10-30 21:40:22 [DEBUG   ] summary = ERROR
2018-10-30 21:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325181  13 58421 78022669 A  ERRORERROR'
2018-10-30 21:40:22 [DEBUG   ] Got command RPT from MCS: ref #325182
2018-10-30 21:40:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325182  77 58421 78022873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:40:23 [DEBUG   ] Got command RPT from MCS: ref #325183
2018-10-30 21:40:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325183  12 58421 78023065 A  ERRORB'
2018-10-30 21:40:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 21:40:39 [DEBUG   ] Got command RPT from MCS: ref #325184
2018-10-30 21:40:39 [DEBUG   ] summary = ERROR
2018-10-30 21:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325184  13 58421 78039949 A  ERRORERROR'
2018-10-30 21:40:39 [DEBUG   ] Got command RPT from MCS: ref #325185
2018-10-30 21:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325185  77 58421 78039950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:40:55 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-30 21:41:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 21:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:41:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:41:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:41:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:41:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:41:21 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-30 21:41:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:41:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:42:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:42:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:42:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:42:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:42:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:42:21 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-30 21:42:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 21:42:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:43:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:43:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 21:43:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:43:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:43:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:43:21 [WARNING ] (13, 1, 'bot')
2018-10-30 21:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:43:21 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-10-30 21:43:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 21:43:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:44:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:44:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:44:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:44:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:44:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:44:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:44:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:44:22 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-10-30 21:44:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:44:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 21:45:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 21:45:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:45:22 [DEBUG   ] Got command RPT from MCS: ref #325207
2018-10-30 21:45:22 [DEBUG   ] summary = ERROR
2018-10-30 21:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325207  13 58421 78322349 A  ERRORERROR'
2018-10-30 21:45:22 [DEBUG   ] Got command RPT from MCS: ref #325208
2018-10-30 21:45:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325208  77 58421 78322558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:45:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:45:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:45:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:45:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:45:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:45:22 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-30 21:45:22 [DEBUG   ] Got command RPT from MCS: ref #325209
2018-10-30 21:45:22 [DEBUG   ] summary = ERROR
2018-10-30 21:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325209  13 58421 78322749 A  ERRORERROR'
2018-10-30 21:45:22 [DEBUG   ] Got command RPT from MCS: ref #325211
2018-10-30 21:45:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325211  77 58421 78322953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:45:23 [DEBUG   ] Got command RPT from MCS: ref #325213
2018-10-30 21:45:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325213  12 58421 78323157 A  ERRORB'
2018-10-30 21:45:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 21:45:39 [DEBUG   ] Got command RPT from MCS: ref #325217
2018-10-30 21:45:39 [DEBUG   ] summary = ERROR
2018-10-30 21:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325217  13 58421 78339957 A  ERRORERROR'
2018-10-30 21:45:39 [DEBUG   ] Got command RPT from MCS: ref #325218
2018-10-30 21:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325218  77 58421 78339958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:45:56 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-10-30 21:46:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 21:46:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:46:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:46:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:46:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:46:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:46:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:46:22 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-30 21:46:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 21:46:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 21:47:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 21:47:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 21:47:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:47:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:47:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:47:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:47:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:47:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:47:22 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-30 21:47:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 21:47:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 21:48:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:48:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 21:48:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:48:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 21:48:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:48:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:48:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:48:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:48:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:48:22 [DEBUG   ] Finished updating board flags in 1.713 seconds
2018-10-30 21:48:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 21:48:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:49:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:49:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:49:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 21:49:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:49:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:49:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:49:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:49:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:49:22 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-30 21:49:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:49:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 21:50:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 21:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 21:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 21:50:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:50:22 [DEBUG   ] Got command RPT from MCS: ref #325242
2018-10-30 21:50:22 [DEBUG   ] summary = ERROR
2018-10-30 21:50:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325242  13 58421 78622434 A  ERRORERROR'
2018-10-30 21:50:22 [DEBUG   ] Got command RPT from MCS: ref #325243
2018-10-30 21:50:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:50:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325243  77 58421 78622630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:50:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:50:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:50:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:50:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:50:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:50:22 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-30 21:50:22 [DEBUG   ] Got command RPT from MCS: ref #325244
2018-10-30 21:50:22 [DEBUG   ] summary = ERROR
2018-10-30 21:50:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325244  13 58421 78622833 A  ERRORERROR'
2018-10-30 21:50:23 [DEBUG   ] Got command RPT from MCS: ref #325245
2018-10-30 21:50:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325245  77 58421 78623037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:50:23 [DEBUG   ] Got command RPT from MCS: ref #325246
2018-10-30 21:50:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325246  12 58421 78623241 A  ERRORB'
2018-10-30 21:50:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 21:50:39 [DEBUG   ] Got command RPT from MCS: ref #325247
2018-10-30 21:50:39 [DEBUG   ] summary = ERROR
2018-10-30 21:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325247  13 58421 78639957 A  ERRORERROR'
2018-10-30 21:50:39 [DEBUG   ] Got command RPT from MCS: ref #325248
2018-10-30 21:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325248  77 58421 78639958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:50:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 21:51:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 21:51:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:51:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:51:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:51:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:51:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:51:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:51:22 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-30 21:51:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 21:51:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 21:52:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 21:52:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:52:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:52:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:52:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:52:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:52:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:52:22 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-30 21:52:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 21:52:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 21:53:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 21:53:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:53:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:53:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:53:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:53:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:53:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:53:22 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-30 21:53:37 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-30 21:53:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 21:54:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:54:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 21:54:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:54:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:54:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:54:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:54:22 [WARNING ] (13, 1, 'bot')
2018-10-30 21:54:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:54:22 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-30 21:54:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 21:54:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 21:55:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 21:55:22 [DEBUG   ] Got command RPT from MCS: ref #325274
2018-10-30 21:55:22 [DEBUG   ] summary = ERROR
2018-10-30 21:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325274  13 58421 78922517 A  ERRORERROR'
2018-10-30 21:55:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:55:22 [DEBUG   ] Got command RPT from MCS: ref #325275
2018-10-30 21:55:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325275  77 58421 78922721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:55:22 [DEBUG   ] Got command RPT from MCS: ref #325276
2018-10-30 21:55:22 [DEBUG   ] summary = ERROR
2018-10-30 21:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325276  13 58421 78922925 A  ERRORERROR'
2018-10-30 21:55:23 [DEBUG   ] Got command RPT from MCS: ref #325278
2018-10-30 21:55:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:55:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325278  77 58421 78923117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:55:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:55:23 [DEBUG   ] Got command RPT from MCS: ref #325279
2018-10-30 21:55:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 21:55:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325279  12 58421 78923326 A  ERRORB'
2018-10-30 21:55:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:55:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:55:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:55:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:55:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:55:23 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-10-30 21:55:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 21:55:39 [DEBUG   ] Got command RPT from MCS: ref #325284
2018-10-30 21:55:39 [DEBUG   ] summary = ERROR
2018-10-30 21:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325284  13 58421 78939949 A  ERRORERROR'
2018-10-30 21:55:39 [DEBUG   ] Got command RPT from MCS: ref #325285
2018-10-30 21:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 21:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325285  77 58421 78939950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 21:55:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 21:56:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 21:56:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:56:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:56:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:56:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:56:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:56:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:56:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:56:23 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-30 21:56:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 21:56:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-30 21:57:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 21:57:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:57:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 21:57:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:57:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:57:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:57:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:57:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:57:23 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-10-30 21:57:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 21:57:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 21:58:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 21:58:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:58:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:58:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:58:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:58:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:58:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:58:23 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-30 21:58:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 21:58:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 21:59:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-30 21:59:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 21:59:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 21:59:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:59:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:59:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:59:23 [WARNING ] (13, 1, 'bot')
2018-10-30 21:59:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 21:59:23 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-30 21:59:38 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-30 21:59:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:00:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 22:00:22 [DEBUG   ] Got command RPT from MCS: ref #325305
2018-10-30 22:00:22 [DEBUG   ] summary = ERROR
2018-10-30 22:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325305  13 58421 79222609 A  ERRORERROR'
2018-10-30 22:00:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:00:22 [DEBUG   ] Got command RPT from MCS: ref #325306
2018-10-30 22:00:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325306  77 58421 79222813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:00:23 [DEBUG   ] Got command RPT from MCS: ref #325307
2018-10-30 22:00:23 [DEBUG   ] summary = ERROR
2018-10-30 22:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325307  13 58421 79223005 A  ERRORERROR'
2018-10-30 22:00:23 [DEBUG   ] Got command RPT from MCS: ref #325308
2018-10-30 22:00:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325308  77 58421 79223209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:00:23 [DEBUG   ] Got command RPT from MCS: ref #325309
2018-10-30 22:00:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325309  12 58421 79223414 A  ERRORB'
2018-10-30 22:00:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:00:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:00:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:00:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:00:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:00:23 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-30 22:00:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 22:00:39 [DEBUG   ] Got command RPT from MCS: ref #325310
2018-10-30 22:00:39 [DEBUG   ] summary = ERROR
2018-10-30 22:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325310  13 58421 79239949 A  ERRORERROR'
2018-10-30 22:00:39 [DEBUG   ] Got command RPT from MCS: ref #325311
2018-10-30 22:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325311  77 58421 79239950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:00:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 22:01:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 22:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:01:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:01:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:01:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:01:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:01:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:01:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:01:23 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-30 22:01:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 22:01:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-30 22:02:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 22:02:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:02:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:02:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:02:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:02:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:02:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:02:23 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-30 22:02:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:02:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 22:03:19 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-30 22:03:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 22:03:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:03:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:03:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:03:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:03:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:03:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:03:23 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-30 22:03:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:03:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 22:04:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 22:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:04:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:04:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:04:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:04:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:04:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:04:23 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-30 22:04:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:04:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 22:05:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 22:05:22 [DEBUG   ] Got command RPT from MCS: ref #325337
2018-10-30 22:05:22 [DEBUG   ] summary = ERROR
2018-10-30 22:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325337  13 58421 79522698 A  ERRORERROR'
2018-10-30 22:05:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 22:05:22 [DEBUG   ] Got command RPT from MCS: ref #325338
2018-10-30 22:05:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325338  77 58421 79522894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:05:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:05:23 [DEBUG   ] Got command RPT from MCS: ref #325339
2018-10-30 22:05:23 [DEBUG   ] summary = ERROR
2018-10-30 22:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325339  13 58421 79523097 A  ERRORERROR'
2018-10-30 22:05:23 [DEBUG   ] Got command RPT from MCS: ref #325341
2018-10-30 22:05:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325341  77 58421 79523301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:05:23 [DEBUG   ] Got command RPT from MCS: ref #325342
2018-10-30 22:05:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325342  12 58421 79523497 A  ERRORB'
2018-10-30 22:05:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:05:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:05:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:05:23 [WARNING ] (13, 1, 'bot')
2018-10-30 22:05:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:05:23 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-10-30 22:05:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 22:05:39 [DEBUG   ] Got command RPT from MCS: ref #325347
2018-10-30 22:05:39 [DEBUG   ] summary = ERROR
2018-10-30 22:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325347  13 58421 79539961 A  ERRORERROR'
2018-10-30 22:05:39 [DEBUG   ] Got command RPT from MCS: ref #325348
2018-10-30 22:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325348  77 58421 79539962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:05:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 22:06:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 22:06:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:06:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:06:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:06:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:06:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:06:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:06:24 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-30 22:06:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 22:07:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 22:07:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:07:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:07:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:07:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:07:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:07:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:07:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:07:24 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-10-30 22:07:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 22:08:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 22:08:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 22:08:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:08:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:08:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:08:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:08:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:08:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:08:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:08:24 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-10-30 22:08:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:09:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 22:09:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:09:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:09:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:09:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:09:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:09:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:09:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:09:24 [DEBUG   ] Finished updating board flags in 1.768 seconds
2018-10-30 22:09:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:10:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:10:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 22:10:22 [DEBUG   ] Got command RPT from MCS: ref #325372
2018-10-30 22:10:22 [DEBUG   ] summary = ERROR
2018-10-30 22:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325372  13 58421 79822785 A  ERRORERROR'
2018-10-30 22:10:22 [DEBUG   ] Got command RPT from MCS: ref #325373
2018-10-30 22:10:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325373  77 58421 79822977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:10:23 [DEBUG   ] Got command RPT from MCS: ref #325374
2018-10-30 22:10:23 [DEBUG   ] summary = ERROR
2018-10-30 22:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325374  13 58421 79823185 A  ERRORERROR'
2018-10-30 22:10:23 [DEBUG   ] Got command RPT from MCS: ref #325375
2018-10-30 22:10:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325375  77 58421 79823377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:10:23 [DEBUG   ] Got command RPT from MCS: ref #325376
2018-10-30 22:10:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325376  12 58421 79823581 A  ERRORBĚÍ'
2018-10-30 22:10:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:10:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 22:10:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:10:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:10:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:10:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:10:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:10:24 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-30 22:10:39 [DEBUG   ] Got command RPT from MCS: ref #325377
2018-10-30 22:10:39 [DEBUG   ] summary = ERROR
2018-10-30 22:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325377  13 58421 79839957 A  ERRORERROR'
2018-10-30 22:10:39 [DEBUG   ] Got command RPT from MCS: ref #325378
2018-10-30 22:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325378  77 58421 79839958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:10:40 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 22:11:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 22:11:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 22:11:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:11:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:11:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:11:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:11:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:11:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:11:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:11:24 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-30 22:11:41 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-30 22:12:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 22:12:21 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-30 22:12:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:12:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 22:12:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:12:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:12:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:12:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:12:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:12:24 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-30 22:12:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:13:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 22:13:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 22:13:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:13:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:13:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:13:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:13:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:13:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:13:24 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-10-30 22:13:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:14:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 22:14:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 22:14:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:14:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 22:14:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:14:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:14:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:14:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:14:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:14:24 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-30 22:14:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 22:15:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-30 22:15:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 22:15:22 [DEBUG   ] Got command RPT from MCS: ref #325400
2018-10-30 22:15:22 [DEBUG   ] summary = ERROR
2018-10-30 22:15:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325400  13 58421 80122865 A  ERRORERROR'
2018-10-30 22:15:23 [DEBUG   ] Got command RPT from MCS: ref #325401
2018-10-30 22:15:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325401  77 58421 80123069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:15:23 [DEBUG   ] Got command RPT from MCS: ref #325402
2018-10-30 22:15:23 [DEBUG   ] summary = ERROR
2018-10-30 22:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325402  13 58421 80123261 A  ERRORERROR'
2018-10-30 22:15:23 [DEBUG   ] Got command RPT from MCS: ref #325404
2018-10-30 22:15:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325404  77 58421 80123466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:15:23 [DEBUG   ] Got command RPT from MCS: ref #325405
2018-10-30 22:15:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325405  12 58421 80123661 A  ERRORBĚÍ'
2018-10-30 22:15:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:15:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 22:15:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:15:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:15:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:15:24 [WARNING ] (13, 1, 'bot')
2018-10-30 22:15:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:15:24 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-30 22:15:39 [DEBUG   ] Got command RPT from MCS: ref #325410
2018-10-30 22:15:39 [DEBUG   ] summary = ERROR
2018-10-30 22:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325410  13 58421 80139957 A  ERRORERROR'
2018-10-30 22:15:39 [DEBUG   ] Got command RPT from MCS: ref #325411
2018-10-30 22:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325411  77 58421 80139958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:15:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-30 22:16:02 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-30 22:16:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 22:16:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 22:16:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:16:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:16:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:16:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:16:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:16:25 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-30 22:16:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 22:17:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:17:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:17:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:17:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:17:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:17:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:17:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:17:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:17:25 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-30 22:17:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-30 22:18:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 22:18:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:18:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 22:18:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:18:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:18:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:18:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:18:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:18:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:18:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:18:25 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-10-30 22:18:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:19:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-30 22:19:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:19:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:19:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:19:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:19:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:19:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:19:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:19:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:19:25 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-30 22:19:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 22:20:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 22:20:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 22:20:22 [DEBUG   ] Got command RPT from MCS: ref #325435
2018-10-30 22:20:22 [DEBUG   ] summary = ERROR
2018-10-30 22:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325435  13 58421 80422949 A  ERRORERROR'
2018-10-30 22:20:23 [DEBUG   ] Got command RPT from MCS: ref #325436
2018-10-30 22:20:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325436  77 58421 80423153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:20:23 [DEBUG   ] Got command RPT from MCS: ref #325437
2018-10-30 22:20:23 [DEBUG   ] summary = ERROR
2018-10-30 22:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325437  13 58421 80423345 A  ERRORERROR'
2018-10-30 22:20:23 [DEBUG   ] Got command RPT from MCS: ref #325438
2018-10-30 22:20:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325438  77 58421 80423549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:20:23 [DEBUG   ] Got command RPT from MCS: ref #325439
2018-10-30 22:20:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325439  12 58421 80423753 A  ERRORB'
2018-10-30 22:20:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:20:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:20:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:20:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:20:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:20:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:20:25 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-30 22:20:39 [DEBUG   ] Got command RPT from MCS: ref #325440
2018-10-30 22:20:39 [DEBUG   ] summary = ERROR
2018-10-30 22:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325440  13 58421 80439961 A  ERRORERROR'
2018-10-30 22:20:39 [DEBUG   ] Got command RPT from MCS: ref #325441
2018-10-30 22:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325441  77 58421 80439962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:20:42 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-30 22:21:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-30 22:21:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 22:21:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:21:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:21:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:21:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:21:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:21:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:21:25 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-30 22:21:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 22:22:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 22:22:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:22:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:22:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:22:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:22:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:22:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:22:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:22:25 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-30 22:22:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-30 22:23:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 22:23:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:23:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:23:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:23:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:23:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:23:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:23:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:23:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:23:25 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-30 22:23:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 22:24:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:24:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:24:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:24:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:24:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:24:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:24:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:24:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:24:25 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-30 22:24:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:25:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 22:25:23 [DEBUG   ] Got command RPT from MCS: ref #325467
2018-10-30 22:25:23 [DEBUG   ] summary = ERROR
2018-10-30 22:25:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325467  13 58421 80723037 A  ERRORERROR'
2018-10-30 22:25:23 [DEBUG   ] Got command RPT from MCS: ref #325468
2018-10-30 22:25:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:25:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325468  77 58421 80723229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:25:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-30 22:25:23 [DEBUG   ] Got command RPT from MCS: ref #325469
2018-10-30 22:25:23 [DEBUG   ] summary = ERROR
2018-10-30 22:25:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325469  13 58421 80723433 A  ERRORERROR'
2018-10-30 22:25:23 [DEBUG   ] Got command RPT from MCS: ref #325471
2018-10-30 22:25:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:25:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325471  77 58421 80723637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:25:23 [DEBUG   ] Got command RPT from MCS: ref #325472
2018-10-30 22:25:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:25:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325472  12 58421 80723841 A  ERRORB'
2018-10-30 22:25:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 22:25:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:25:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:25:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:25:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:25:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:25:25 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-30 22:25:39 [DEBUG   ] Got command RPT from MCS: ref #325477
2018-10-30 22:25:39 [DEBUG   ] summary = ERROR
2018-10-30 22:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325477  13 58421 80739961 A  ERRORERROR'
2018-10-30 22:25:39 [DEBUG   ] Got command RPT from MCS: ref #325478
2018-10-30 22:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325478  77 58421 80739962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:25:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 22:26:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 22:26:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-30 22:26:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:26:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:26:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:26:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:26:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:26:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:26:25 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-30 22:26:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-30 22:27:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:27:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 22:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 22:27:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:27:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:27:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:27:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:27:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:27:25 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-30 22:27:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 22:28:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 22:28:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:28:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:28:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:28:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:28:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:28:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:28:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:28:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:28:25 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-30 22:28:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 22:29:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:29:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:29:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:29:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 22:29:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 22:29:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:29:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:29:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:29:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:29:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:29:25 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-10-30 22:29:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:30:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 22:30:23 [DEBUG   ] Got command RPT from MCS: ref #325498
2018-10-30 22:30:23 [DEBUG   ] summary = ERROR
2018-10-30 22:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325498  13 58421 81023117 A  ERRORERROR'
2018-10-30 22:30:23 [DEBUG   ] Got command RPT from MCS: ref #325499
2018-10-30 22:30:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325499  77 58421 81023321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:30:23 [DEBUG   ] Got command RPT from MCS: ref #325500
2018-10-30 22:30:23 [DEBUG   ] summary = ERROR
2018-10-30 22:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325500  13 58421 81023525 A  ERRORERROR'
2018-10-30 22:30:23 [DEBUG   ] Got command RPT from MCS: ref #325501
2018-10-30 22:30:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325501  77 58421 81023717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:30:23 [DEBUG   ] Got command RPT from MCS: ref #325502
2018-10-30 22:30:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325502  12 58421 81023921 A  ERRORB'
2018-10-30 22:30:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 22:30:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:30:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:30:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:30:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:30:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:30:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:30:25 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-30 22:30:39 [DEBUG   ] Got command RPT from MCS: ref #325503
2018-10-30 22:30:39 [DEBUG   ] summary = ERROR
2018-10-30 22:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325503  13 58421 81039961 A  ERRORERROR'
2018-10-30 22:30:39 [DEBUG   ] Got command RPT from MCS: ref #325504
2018-10-30 22:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325504  77 58421 81039962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:30:44 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-30 22:31:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 22:31:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:31:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-30 22:31:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:31:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:31:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:31:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:31:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:31:25 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-30 22:31:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-30 22:32:05 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2018-10-30 22:32:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:32:25 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2018-10-30 22:32:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:32:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:32:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:32:25 [WARNING ] (13, 1, 'bot')
2018-10-30 22:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:32:25 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-10-30 22:32:45 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-30 22:33:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 22:33:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:33:25 [DEBUG   ] Finished updating ant stats in 0.853 seconds
2018-10-30 22:33:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:33:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:33:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:33:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:33:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:33:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:33:26 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-10-30 22:33:45 [DEBUG   ] Finished updating ant stats in 0.751 seconds
2018-10-30 22:34:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-30 22:34:25 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-10-30 22:34:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:34:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:34:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:34:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:34:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:34:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:34:26 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-10-30 22:34:45 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-30 22:35:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 22:35:23 [DEBUG   ] Got command RPT from MCS: ref #325530
2018-10-30 22:35:23 [DEBUG   ] summary = ERROR
2018-10-30 22:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325530  13 58421 81323205 A  ERRORERROR'
2018-10-30 22:35:23 [DEBUG   ] Got command RPT from MCS: ref #325531
2018-10-30 22:35:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325531  77 58421 81323409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:35:23 [DEBUG   ] Got command RPT from MCS: ref #325532
2018-10-30 22:35:23 [DEBUG   ] summary = ERROR
2018-10-30 22:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325532  13 58421 81323601 A  ERRORERROR'
2018-10-30 22:35:23 [DEBUG   ] Got command RPT from MCS: ref #325534
2018-10-30 22:35:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325534  77 58421 81323805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:35:24 [DEBUG   ] Got command RPT from MCS: ref #325536
2018-10-30 22:35:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325536  12 58421 81324009 A  ERRORB'
2018-10-30 22:35:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:35:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-30 22:35:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:35:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:35:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:35:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:35:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:35:26 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-30 22:35:39 [DEBUG   ] Got command RPT from MCS: ref #325540
2018-10-30 22:35:39 [DEBUG   ] summary = ERROR
2018-10-30 22:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325540  13 58421 81339961 A  ERRORERROR'
2018-10-30 22:35:39 [DEBUG   ] Got command RPT from MCS: ref #325541
2018-10-30 22:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325541  77 58421 81339962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:35:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 22:36:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:36:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:36:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:36:26 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2018-10-30 22:36:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:36:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:36:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:36:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:36:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:36:26 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-10-30 22:36:46 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2018-10-30 22:37:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 22:37:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:37:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 22:37:26 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-10-30 22:37:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:37:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:37:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:37:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:37:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:37:26 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-30 22:37:46 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-10-30 22:38:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:38:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:38:26 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-10-30 22:38:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:38:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:38:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:38:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:38:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:38:26 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-10-30 22:38:46 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-10-30 22:39:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 22:39:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:39:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:39:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:39:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:39:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:39:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:39:26 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-10-30 22:39:27 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 22:39:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 22:40:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 22:40:23 [DEBUG   ] Got command RPT from MCS: ref #325565
2018-10-30 22:40:23 [DEBUG   ] summary = ERROR
2018-10-30 22:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325565  13 58421 81623293 A  ERRORERROR'
2018-10-30 22:40:23 [DEBUG   ] Got command RPT from MCS: ref #325566
2018-10-30 22:40:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325566  77 58421 81623497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:40:23 [DEBUG   ] Got command RPT from MCS: ref #325567
2018-10-30 22:40:23 [DEBUG   ] summary = ERROR
2018-10-30 22:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325567  13 58421 81623689 A  ERRORERROR'
2018-10-30 22:40:23 [DEBUG   ] Got command RPT from MCS: ref #325568
2018-10-30 22:40:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325568  77 58421 81623897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:40:24 [DEBUG   ] Got command RPT from MCS: ref #325569
2018-10-30 22:40:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325569  12 58421 81624097 A  ERRORB'
2018-10-30 22:40:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:40:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:40:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:40:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:40:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:40:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:40:26 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-10-30 22:40:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 22:40:39 [DEBUG   ] Got command RPT from MCS: ref #325570
2018-10-30 22:40:39 [DEBUG   ] summary = ERROR
2018-10-30 22:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325570  13 58421 81639961 A  ERRORERROR'
2018-10-30 22:40:39 [DEBUG   ] Got command RPT from MCS: ref #325571
2018-10-30 22:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325571  77 58421 81639962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:40:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:41:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:41:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:41:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:41:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:41:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:41:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:41:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:41:26 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-10-30 22:41:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 22:41:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 22:42:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 22:42:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:42:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:42:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:42:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:42:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:42:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:42:26 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-10-30 22:42:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 22:42:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 22:43:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:43:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:43:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:43:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:43:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:43:26 [WARNING ] (13, 1, 'bot')
2018-10-30 22:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:43:26 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-10-30 22:43:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:43:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:44:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:44:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:44:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:44:27 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-10-30 22:44:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:44:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:44:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:44:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:44:27 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-10-30 22:44:47 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-30 22:45:08 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-30 22:45:23 [DEBUG   ] Got command RPT from MCS: ref #325593
2018-10-30 22:45:23 [DEBUG   ] summary = ERROR
2018-10-30 22:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325593  13 58421 81923381 A  ERRORERROR'
2018-10-30 22:45:23 [DEBUG   ] Got command RPT from MCS: ref #325594
2018-10-30 22:45:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325594  77 58421 81923573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:45:23 [DEBUG   ] Got command RPT from MCS: ref #325595
2018-10-30 22:45:23 [DEBUG   ] summary = ERROR
2018-10-30 22:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325595  13 58421 81923777 A  ERRORERROR'
2018-10-30 22:45:23 [DEBUG   ] Got command RPT from MCS: ref #325597
2018-10-30 22:45:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325597  77 58421 81923981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:45:24 [DEBUG   ] Got command RPT from MCS: ref #325598
2018-10-30 22:45:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325598  12 58421 81924185 A  ERRORB'
2018-10-30 22:45:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:45:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:45:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-30 22:45:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:45:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:45:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:45:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:45:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:45:27 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-10-30 22:45:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-30 22:45:39 [DEBUG   ] Got command RPT from MCS: ref #325603
2018-10-30 22:45:39 [DEBUG   ] summary = ERROR
2018-10-30 22:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325603  13 58421 81939965 A  ERRORERROR'
2018-10-30 22:45:39 [DEBUG   ] Got command RPT from MCS: ref #325604
2018-10-30 22:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325604  77 58421 81939966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:45:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 22:46:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 22:46:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:46:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:46:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:46:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:46:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:46:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:46:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:46:27 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-30 22:46:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 22:46:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 22:47:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 22:47:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 22:47:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:47:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:47:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:47:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:47:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:47:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:47:27 [DEBUG   ] Finished updating board flags in 2.157 seconds
2018-10-30 22:47:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 22:47:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 22:48:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:48:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 22:48:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:48:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:48:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:48:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:48:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:48:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:48:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:48:27 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-30 22:48:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:48:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 22:49:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:49:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:49:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:49:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:49:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:49:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:49:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:49:27 [DEBUG   ] Finished updating board flags in 1.936 seconds
2018-10-30 22:49:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:49:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 22:50:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-30 22:50:23 [DEBUG   ] Got command RPT from MCS: ref #325628
2018-10-30 22:50:23 [DEBUG   ] summary = ERROR
2018-10-30 22:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325628  13 58421 82223461 A  ERRORERROR'
2018-10-30 22:50:23 [DEBUG   ] Got command RPT from MCS: ref #325629
2018-10-30 22:50:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325629  77 58421 82223665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:50:23 [DEBUG   ] Got command RPT from MCS: ref #325630
2018-10-30 22:50:23 [DEBUG   ] summary = ERROR
2018-10-30 22:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325630  13 58421 82223869 A  ERRORERROR'
2018-10-30 22:50:24 [DEBUG   ] Got command RPT from MCS: ref #325631
2018-10-30 22:50:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325631  77 58421 82224061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:50:24 [DEBUG   ] Got command RPT from MCS: ref #325632
2018-10-30 22:50:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 22:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325632  12 58421 82224265 A  ERRORB'
2018-10-30 22:50:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:50:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:50:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:50:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:50:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:50:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:50:27 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-30 22:50:29 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-30 22:50:39 [DEBUG   ] Got command RPT from MCS: ref #325633
2018-10-30 22:50:39 [DEBUG   ] summary = ERROR
2018-10-30 22:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325633  13 58421 82239973 A  ERRORERROR'
2018-10-30 22:50:39 [DEBUG   ] Got command RPT from MCS: ref #325634
2018-10-30 22:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325634  77 58421 82239974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:50:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-30 22:51:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-30 22:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:51:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:51:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:51:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:51:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:51:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:51:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:51:27 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-10-30 22:51:29 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-30 22:51:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 22:52:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-30 22:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:52:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:52:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:52:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:52:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:52:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:52:27 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-30 22:52:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-30 22:52:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-30 22:53:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 22:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:53:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-30 22:53:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:53:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:53:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:53:27 [WARNING ] (13, 1, 'bot')
2018-10-30 22:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:53:27 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-30 22:53:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-30 22:53:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-30 22:54:00 [DEBUG   ] Got command RPT from MCS: ref #325654
2018-10-30 22:54:00 [DEBUG   ] summary = ERROR
2018-10-30 22:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325654  13 58421 82440472 A  ERRORERROR'
2018-10-30 22:54:00 [DEBUG   ] Got command RPT from MCS: ref #325655
2018-10-30 22:54:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325655  77 58421 82440472 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:54:05 [DEBUG   ] Got command INI from MCS: ref #325656
2018-10-30 22:54:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-30 22:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   325656   8 58421 82445238 ABOOTING'
2018-10-30 22:54:09 [DEBUG   ] Finished updating ant stats in 0.836 seconds
2018-10-30 22:54:29 [INFO    ] -------------------
2018-10-30 22:54:29 [INFO    ]  LWA board status
2018-10-30 22:54:29 [INFO    ] -------------------
2018-10-30 22:54:29 [INFO    ] DP 1: 2 lwa27
2018-10-30 22:54:29 [INFO    ] DP 1: 3 lwa24
2018-10-30 22:54:29 [INFO    ] DP 1: 4 lwa23
2018-10-30 22:54:29 [INFO    ] DP 1: 5 lwa18
2018-10-30 22:54:29 [INFO    ] DP 1: 6 lwa10
2018-10-30 22:54:29 [INFO    ] DP 1: 7 lwa32
2018-10-30 22:54:29 [INFO    ] DP 1: 8 lwa11
2018-10-30 22:54:29 [INFO    ] DP 1: 9 lwa30
2018-10-30 22:54:29 [INFO    ] DP 1: 10 lwa12
2018-10-30 22:54:29 [INFO    ] DP 1: 11 lwa8
2018-10-30 22:54:29 [INFO    ] DP 1: 12 lwa13
2018-10-30 22:54:29 [INFO    ] DP 1: 13 lwa26
2018-10-30 22:54:29 [INFO    ] DP 1: 14 lwa14
2018-10-30 22:54:29 [INFO    ] DP 1: 16 lwa22
2018-10-30 22:54:29 [INFO    ] DP 1: 17 lwa20
2018-10-30 22:54:29 [INFO    ] DP 1: 18 lwa1
2018-10-30 22:54:29 [INFO    ] DP 1: 19 lwa5
2018-10-30 22:54:29 [INFO    ] DP 1: 20 lwa25
2018-10-30 22:54:29 [INFO    ] DP 1: 21 lwa35
2018-10-30 22:54:29 [INFO    ] DP 1: 22 lwa19
2018-10-30 22:54:29 [INFO    ] DP 1: 23 lwa21
2018-10-30 22:54:29 [INFO    ] DP 1: 24 lwa6
2018-10-30 22:54:29 [INFO    ] DP 1: 25 lwa7
2018-10-30 22:54:29 [INFO    ] DP 1: 26 lwa33
2018-10-30 22:54:29 [INFO    ] DP 1: 27 lwa15
2018-10-30 22:54:29 [INFO    ] DP 1: 28 lwa28
2018-10-30 22:54:29 [INFO    ] DP 2: 1 lwa16
2018-10-30 22:54:29 [INFO    ] DP 2: 15 lwa34
2018-10-30 22:54:29 [INFO    ] Total of 28 boards
2018-10-30 22:54:29 [INFO    ] Total of 260 stands
2018-10-30 22:54:29 [INFO    ] -------------------
2018-10-30 22:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15794
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15795
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15796
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15797
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15798
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15799
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15800
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15801
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15802
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15803
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15804
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15805
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15806
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15807
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15808
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15809
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15810
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15811
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15812
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15813
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15814
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15815
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15816
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15817
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15818
2018-10-30 22:54:36 [DEBUG   ] 2018-10-30 22:54:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15819
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15794 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15795 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15796 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15797 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15798 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15799 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15800 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15801 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15802 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15803 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15804 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15805 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15806 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15807 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15808 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15809 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15810 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15811 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15812 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15813 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15814 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15815 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15816 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15817 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15818 exited with status 0
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15819 exited with status 0
2018-10-30 22:54:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] spawn_process: at 2018-10-30 22:54:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15846
2018-10-30 22:54:49 [DEBUG   ] 2018-10-30 22:54:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15847
2018-10-30 22:54:54 [DEBUG   ] 2018-10-30 22:54:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15846 exited with status 0
2018-10-30 22:54:54 [DEBUG   ] 2018-10-30 22:54:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15847 exited with status 0
2018-10-30 22:54:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-30 22:54:54 [DEBUG   ] spawn_process: at 2018-10-30 22:54:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-30 22:54:54 [DEBUG   ] spawn_process: at 2018-10-30 22:54:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-30 22:54:54 [INFO    ] Setting Beam 1 xbars
2018-10-30 22:54:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-30 22:54:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-30 22:54:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-30 22:54:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-30 22:54:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-30 22:54:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-30 22:54:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-30 22:54:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-30 22:54:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-30 22:55:00 [INFO    ] Setting Beam 2 xbars
2018-10-30 22:55:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-30 22:55:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-30 22:55:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-30 22:55:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-30 22:55:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-30 22:55:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-30 22:55:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-30 22:55:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-30 22:55:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-30 22:55:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-30 22:55:05 [INFO    ] Setting Beam 3 xbars
2018-10-30 22:55:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-30 22:55:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-30 22:55:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-30 22:55:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-30 22:55:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-30 22:55:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-30 22:55:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-30 22:55:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-30 22:55:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-30 22:55:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-30 22:55:10 [INFO    ] Setting Beam 4 xbars
2018-10-30 22:55:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-30 22:55:10 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-30 22:55:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-30 22:55:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-30 22:55:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-30 22:55:14 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-30 22:55:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-30 22:55:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-30 22:55:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-30 22:55:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-30 22:55:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-30 22:55:16 [INFO    ] All xbars set
2018-10-30 22:55:16 [INFO    ] Setting adder chain routing for all beams
2018-10-30 22:55:21 [INFO    ] Setting beam ids
2018-10-30 22:55:23 [DEBUG   ] Got command RPT from MCS: ref #325663
2018-10-30 22:55:23 [DEBUG   ] summary = BOOTING
2018-10-30 22:55:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325663  15 58421 82523546 ABOOTINGBOOTING'
2018-10-30 22:55:31 [INFO    ] Starting beam delay calibration
2018-10-30 22:55:39 [DEBUG   ] Got command RPT from MCS: ref #325669
2018-10-30 22:55:39 [DEBUG   ] summary = BOOTING
2018-10-30 22:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325669  15 58421 82539974 ABOOTINGBOOTING'
2018-10-30 22:55:39 [DEBUG   ] Got command RPT from MCS: ref #325670
2018-10-30 22:55:39 [DEBUG   ] info = Starting calibration
2018-10-30 22:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325670  28 58421 82539974 ABOOTINGStarting calibration'
2018-10-30 22:55:43 [INFO    ] Beam 1 latency is 5730
2018-10-30 22:55:43 [INFO    ] Beam 2 latency is 6721
2018-10-30 22:55:43 [INFO    ] Beam 3 latency is 6695
2018-10-30 22:55:43 [INFO    ] Beam 4 latency is 5737
2018-10-30 22:55:43 [INFO    ] Stop calibration
2018-10-30 22:55:51 [ERROR   ] Beam delay calibration failed
2018-10-30 22:55:51 [CRITICAL] Calibration failed
2018-10-30 22:55:51 [DEBUG   ] spawn_process: at 2018-10-30 22:55:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-30 22:55:51 [DEBUG   ] spawn_process: at 2018-10-30 22:55:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-30 22:55:51 [DEBUG   ] spawn_process: at 2018-10-30 22:55:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-30 22:55:51 [DEBUG   ] spawn_process: at 2018-10-30 22:55:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-30 22:55:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-30 22:55:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 22:55:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 296 ms (1540940152.298 s) with PID 17432 and time 1540940153
2018-10-30 22:55:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 22:55:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 382 ms (1540940152.385 s) with PID 17435 and time 1540940153
2018-10-30 22:55:53 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-10-30 22:55:53 [INFO    ] Started antennas statistics background thread
2018-10-30 22:55:53 [INFO    ] Started board flags background thread
2018-10-30 22:55:53 [INFO    ] Started BAM background thread
2018-10-30 22:55:53 [INFO    ] Finished the INI process (ref. #325656) in 108.268 s
2018-10-30 22:55:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:55:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:55:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:55:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:55:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:55:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-30 22:55:54 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-10-30 22:56:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 22:56:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:56:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:56:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 22:56:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:56:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:56:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:56:54 [WARNING ] (13, 1, 'bot')
2018-10-30 22:56:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-30 22:56:54 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-10-30 22:57:05 [DEBUG   ] Got command RPT from MCS: ref #325686
2018-10-30 22:57:05 [DEBUG   ] summary = ERROR
2018-10-30 22:57:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325686  13 58421 82625233 A  ERRORERROR'
2018-10-30 22:57:05 [DEBUG   ] Got command RPT from MCS: ref #325687
2018-10-30 22:57:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 22:57:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325687  98 58421 82625234 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 22:57:10 [DEBUG   ] Got command INI from MCS: ref #325688
2018-10-30 22:57:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-30 22:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   325688   8 58421 82630242 ABOOTING'
2018-10-30 22:57:13 [DEBUG   ] Finished updating ant stats in 0.620 seconds
2018-10-30 22:57:30 [INFO    ] -------------------
2018-10-30 22:57:30 [INFO    ]  LWA board status
2018-10-30 22:57:30 [INFO    ] -------------------
2018-10-30 22:57:30 [INFO    ] DP 1: 2 lwa27
2018-10-30 22:57:30 [INFO    ] DP 1: 3 lwa24
2018-10-30 22:57:30 [INFO    ] DP 1: 4 lwa23
2018-10-30 22:57:30 [INFO    ] DP 1: 5 lwa18
2018-10-30 22:57:30 [INFO    ] DP 1: 6 lwa10
2018-10-30 22:57:30 [INFO    ] DP 1: 7 lwa32
2018-10-30 22:57:30 [INFO    ] DP 1: 8 lwa11
2018-10-30 22:57:30 [INFO    ] DP 1: 9 lwa30
2018-10-30 22:57:30 [INFO    ] DP 1: 10 lwa12
2018-10-30 22:57:30 [INFO    ] DP 1: 11 lwa8
2018-10-30 22:57:30 [INFO    ] DP 1: 12 lwa13
2018-10-30 22:57:30 [INFO    ] DP 1: 13 lwa26
2018-10-30 22:57:30 [INFO    ] DP 1: 14 lwa14
2018-10-30 22:57:30 [INFO    ] DP 1: 16 lwa22
2018-10-30 22:57:30 [INFO    ] DP 1: 17 lwa20
2018-10-30 22:57:30 [INFO    ] DP 1: 18 lwa1
2018-10-30 22:57:30 [INFO    ] DP 1: 19 lwa5
2018-10-30 22:57:30 [INFO    ] DP 1: 20 lwa25
2018-10-30 22:57:30 [INFO    ] DP 1: 21 lwa35
2018-10-30 22:57:30 [INFO    ] DP 1: 22 lwa19
2018-10-30 22:57:30 [INFO    ] DP 1: 23 lwa21
2018-10-30 22:57:30 [INFO    ] DP 1: 24 lwa6
2018-10-30 22:57:30 [INFO    ] DP 1: 25 lwa7
2018-10-30 22:57:30 [INFO    ] DP 1: 26 lwa33
2018-10-30 22:57:30 [INFO    ] DP 1: 27 lwa15
2018-10-30 22:57:30 [INFO    ] DP 1: 28 lwa28
2018-10-30 22:57:30 [INFO    ] DP 2: 1 lwa16
2018-10-30 22:57:30 [INFO    ] DP 2: 15 lwa34
2018-10-30 22:57:30 [INFO    ] Total of 28 boards
2018-10-30 22:57:30 [INFO    ] Total of 260 stands
2018-10-30 22:57:30 [INFO    ] -------------------
2018-10-30 22:57:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17986
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17987
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17988
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17989
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17990
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17991
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17992
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17993
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17994
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17995
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17996
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17997
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17998
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17999
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18000
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18001
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18002
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18003
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18004
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18005
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18006
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18007
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18008
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18009
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18010
2018-10-30 22:57:37 [DEBUG   ] 2018-10-30 22:57:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18011
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17986 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17987 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17988 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17989 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17990 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17991 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17992 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17993 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17994 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17995 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17996 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17997 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17998 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17999 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18000 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18001 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18002 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18003 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18004 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18005 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18006 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18007 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18008 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18009 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18010 exited with status 0
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18011 exited with status 0
2018-10-30 22:57:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] spawn_process: at 2018-10-30 22:57:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18038
2018-10-30 22:57:49 [DEBUG   ] 2018-10-30 22:57:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18039
2018-10-30 22:57:55 [DEBUG   ] 2018-10-30 22:57:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18038 exited with status 0
2018-10-30 22:57:55 [DEBUG   ] 2018-10-30 22:57:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18039 exited with status 0
2018-10-30 22:57:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-30 22:57:55 [DEBUG   ] spawn_process: at 2018-10-30 22:57:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-30 22:57:55 [DEBUG   ] spawn_process: at 2018-10-30 22:57:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-30 22:57:55 [INFO    ] Setting Beam 1 xbars
2018-10-30 22:57:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-30 22:57:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-30 22:57:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-30 22:57:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-30 22:57:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-30 22:57:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-30 22:57:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-30 22:57:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-30 22:57:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-30 22:57:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-30 22:58:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-30 22:58:00 [INFO    ] Setting Beam 2 xbars
2018-10-30 22:58:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-30 22:58:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-30 22:58:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-30 22:58:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-30 22:58:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-30 22:58:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-30 22:58:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-30 22:58:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-30 22:58:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-30 22:58:06 [INFO    ] Setting Beam 3 xbars
2018-10-30 22:58:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-30 22:58:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-30 22:58:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-30 22:58:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-30 22:58:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-30 22:58:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-30 22:58:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-30 22:58:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-30 22:58:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-30 22:58:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-30 22:58:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-30 22:58:11 [INFO    ] Setting Beam 4 xbars
2018-10-30 22:58:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-30 22:58:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 22:58:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-30 22:58:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-30 22:58:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-30 22:58:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-30 22:58:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-30 22:58:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-30 22:58:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-30 22:58:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-30 22:58:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-30 22:58:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-30 22:58:17 [INFO    ] All xbars set
2018-10-30 22:58:17 [INFO    ] Setting adder chain routing for all beams
2018-10-30 22:58:22 [INFO    ] Setting beam ids
2018-10-30 22:58:32 [INFO    ] Starting beam delay calibration
2018-10-30 22:58:44 [INFO    ] Beam 1 latency is 5738
2018-10-30 22:58:44 [INFO    ] Beam 2 latency is 5759
2018-10-30 22:58:44 [INFO    ] Beam 3 latency is 5746
2018-10-30 22:58:44 [INFO    ] Beam 4 latency is 5735
2018-10-30 22:58:44 [INFO    ] Stop calibration
2018-10-30 22:58:52 [INFO    ] Beam delay calibration successful
2018-10-30 22:58:52 [INFO    ] Calibration passed
2018-10-30 22:58:52 [DEBUG   ] spawn_process: at 2018-10-30 22:58:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-30 22:58:52 [DEBUG   ] spawn_process: at 2018-10-30 22:58:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-30 22:58:52 [DEBUG   ] spawn_process: at 2018-10-30 22:58:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-30 22:58:52 [DEBUG   ] spawn_process: at 2018-10-30 22:58:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-30 22:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-30 22:58:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 22:58:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 278 ms (1540940333.280 s) with PID 19617 and time 1540940334
2018-10-30 22:58:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-30 22:58:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 366 ms (1540940333.369 s) with PID 19620 and time 1540940334
2018-10-30 22:58:54 [DEBUG   ] Finished updating ant stats in 0.879 seconds
2018-10-30 22:58:54 [INFO    ] Started antennas statistics background thread
2018-10-30 22:58:54 [INFO    ] Started board flags background thread
2018-10-30 22:58:54 [INFO    ] Started BAM background thread
2018-10-30 22:58:54 [INFO    ] Finished the INI process (ref. #325688) in 104.251 s
2018-10-30 22:58:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 22:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:58:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:58:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:58:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:58:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:58:55 [DEBUG   ] Finished updating board flags in 1.066 seconds
2018-10-30 22:59:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 22:59:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 22:59:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 22:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 22:59:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:59:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:59:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:59:55 [WARNING ] (13, 1, 'bot')
2018-10-30 22:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 22:59:55 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-10-30 23:00:10 [DEBUG   ] Got command RPT from MCS: ref #325693
2018-10-30 23:00:10 [DEBUG   ] summary = ERROR
2018-10-30 23:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325693  13 58421 82810238 A  ERRORERROR'
2018-10-30 23:00:10 [DEBUG   ] Got command RPT from MCS: ref #325694
2018-10-30 23:00:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325694  77 58421 82810238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:00:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:00:23 [DEBUG   ] Got command RPT from MCS: ref #325695
2018-10-30 23:00:23 [DEBUG   ] summary = ERROR
2018-10-30 23:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325695  13 58421 82823629 A  ERRORERROR'
2018-10-30 23:00:23 [DEBUG   ] Got command RPT from MCS: ref #325696
2018-10-30 23:00:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325696  77 58421 82823833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:00:24 [DEBUG   ] Got command RPT from MCS: ref #325697
2018-10-30 23:00:24 [DEBUG   ] summary = ERROR
2018-10-30 23:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325697  13 58421 82824037 A  ERRORERROR'
2018-10-30 23:00:24 [DEBUG   ] Got command RPT from MCS: ref #325698
2018-10-30 23:00:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325698  77 58421 82824229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:00:24 [DEBUG   ] Got command RPT from MCS: ref #325699
2018-10-30 23:00:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325699  12 58421 82824433 A  ERRORB'
2018-10-30 23:00:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-30 23:00:39 [DEBUG   ] Got command RPT from MCS: ref #325700
2018-10-30 23:00:39 [DEBUG   ] summary = ERROR
2018-10-30 23:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325700  13 58421 82839965 A  ERRORERROR'
2018-10-30 23:00:39 [DEBUG   ] Got command RPT from MCS: ref #325701
2018-10-30 23:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325701  77 58421 82839966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:00:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:00:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:00:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:00:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:00:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:00:55 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-10-30 23:01:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:01:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:01:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:01:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:01:56 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-30 23:02:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:02:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:02:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:02:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:02:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:02:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:02:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:02:55 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-30 23:03:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:03:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:03:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:03:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:03:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:03:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:03:55 [WARNING ] (13, 1, 'bot')
2018-10-30 23:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:03:55 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-10-30 23:04:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:04:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:04:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:04:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:04:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:04:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:04:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:04:56 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-30 23:05:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:05:23 [DEBUG   ] Got command RPT from MCS: ref #325727
2018-10-30 23:05:23 [DEBUG   ] summary = ERROR
2018-10-30 23:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325727  13 58421 83123717 A  ERRORERROR'
2018-10-30 23:05:23 [DEBUG   ] Got command RPT from MCS: ref #325728
2018-10-30 23:05:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325728  77 58421 83123921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:05:24 [DEBUG   ] Got command RPT from MCS: ref #325729
2018-10-30 23:05:24 [DEBUG   ] summary = ERROR
2018-10-30 23:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325729  13 58421 83124125 A  ERRORERROR'
2018-10-30 23:05:24 [DEBUG   ] Got command RPT from MCS: ref #325731
2018-10-30 23:05:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325731  77 58421 83124313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:05:24 [DEBUG   ] Got command RPT from MCS: ref #325732
2018-10-30 23:05:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325732  12 58421 83124517 A  ERRORB'
2018-10-30 23:05:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:05:39 [DEBUG   ] Got command RPT from MCS: ref #325737
2018-10-30 23:05:39 [DEBUG   ] summary = ERROR
2018-10-30 23:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325737  13 58421 83139969 A  ERRORERROR'
2018-10-30 23:05:39 [DEBUG   ] Got command RPT from MCS: ref #325738
2018-10-30 23:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325738  77 58421 83139970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:05:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:05:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:05:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:05:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:05:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:05:56 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-10-30 23:06:14 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 23:06:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:06:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:06:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:06:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:06:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:06:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:06:56 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-10-30 23:07:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:07:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:07:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-30 23:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:07:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:07:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:07:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:07:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:07:56 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-10-30 23:08:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:08:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:08:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:08:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:08:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:08:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:08:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:08:56 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-10-30 23:09:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 23:09:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:09:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:09:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:09:57 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-30 23:10:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:10:23 [DEBUG   ] Got command RPT from MCS: ref #325762
2018-10-30 23:10:23 [DEBUG   ] summary = ERROR
2018-10-30 23:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325762  13 58421 83423805 A  ERRORERROR'
2018-10-30 23:10:23 [DEBUG   ] Got command RPT from MCS: ref #325763
2018-10-30 23:10:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325763  77 58421 83423997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:10:24 [DEBUG   ] Got command RPT from MCS: ref #325764
2018-10-30 23:10:24 [DEBUG   ] summary = ERROR
2018-10-30 23:10:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325764  13 58421 83424201 A  ERRORERROR'
2018-10-30 23:10:24 [DEBUG   ] Got command RPT from MCS: ref #325765
2018-10-30 23:10:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:10:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325765  77 58421 83424405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:10:24 [DEBUG   ] Got command RPT from MCS: ref #325766
2018-10-30 23:10:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:10:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325766  12 58421 83424609 A  ERRORB'
2018-10-30 23:10:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 23:10:39 [DEBUG   ] Got command RPT from MCS: ref #325767
2018-10-30 23:10:39 [DEBUG   ] summary = ERROR
2018-10-30 23:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325767  13 58421 83439977 A  ERRORERROR'
2018-10-30 23:10:39 [DEBUG   ] Got command RPT from MCS: ref #325768
2018-10-30 23:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325768  77 58421 83439978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:10:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:10:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:10:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:10:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:10:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:10:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:10:56 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-30 23:11:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:11:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:11:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:11:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:11:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:11:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:11:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:11:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:11:56 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-10-30 23:12:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:12:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:12:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:12:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:12:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:12:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:12:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:12:56 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-10-30 23:13:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:13:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:13:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:13:56 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-10-30 23:14:14 [DEBUG   ] Got command BAM from MCS: ref #325792
2018-10-30 23:14:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325792   8 58421 83654029 A  ERROR'
2018-10-30 23:14:14 [DEBUG   ] Got command BAM from MCS: ref #325793
2018-10-30 23:14:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325793   8 58421 83654033 A  ERROR'
2018-10-30 23:14:14 [INFO    ] Finished processing BAM request
2018-10-30 23:14:14 [INFO    ] Finished processing BAM request
2018-10-30 23:14:14 [DEBUG   ] Got command DRX from MCS: ref #325794
2018-10-30 23:14:14 [INFO    ] sending drx command to lwa16
2018-10-30 23:14:14 [DEBUG   ] run_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 68000000.0 6 9 36']
2018-10-30 23:14:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 23:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   325794   8 58421 83654373 A  ERROR'
2018-10-30 23:14:14 [DEBUG   ] Got command DRX from MCS: ref #325795
2018-10-30 23:14:14 [INFO    ] sending drx command to lwa34
2018-10-30 23:14:14 [DEBUG   ] run_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 68000000.0 6 9 36']
2018-10-30 23:14:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 23:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   325795   8 58421 83654381 A  ERROR'
2018-10-30 23:14:14 [DEBUG   ] Got command DRX from MCS: ref #325796
2018-10-30 23:14:14 [INFO    ] sending drx command to lwa16
2018-10-30 23:14:14 [DEBUG   ] run_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 78000000.0 6 9 36']
2018-10-30 23:14:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 23:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   325796   8 58421 83654389 A  ERROR'
2018-10-30 23:14:14 [DEBUG   ] Got command DRX from MCS: ref #325797
2018-10-30 23:14:14 [INFO    ] sending drx command to lwa34
2018-10-30 23:14:14 [DEBUG   ] run_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 78000000.0 6 9 36']
2018-10-30 23:14:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-30 23:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   325797   8 58421 83654397 A  ERROR'
2018-10-30 23:14:14 [INFO    ] Finished starting DRX
2018-10-30 23:14:14 [INFO    ] Finished starting DRX
2018-10-30 23:14:14 [INFO    ] Finished starting DRX
2018-10-30 23:14:14 [INFO    ] Finished starting DRX
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:14:14 [DEBUG   ] spawn_process: at 2018-10-30 23:14:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:14:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-30 23:14:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:14:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-30 23:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:14:56 [DEBUG   ] Finished updating board flags in 0.946 seconds
2018-10-30 23:15:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:15:23 [DEBUG   ] Got command BAM from MCS: ref #325802
2018-10-30 23:15:23 [INFO    ] Finished processing BAM request
2018-10-30 23:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325802   8 58421 83723033 A  ERROR'
2018-10-30 23:15:23 [DEBUG   ] Got command RPT from MCS: ref #325803
2018-10-30 23:15:23 [DEBUG   ] summary = ERROR
2018-10-30 23:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325803  13 58421 83723885 A  ERRORERROR'
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:15:23 [DEBUG   ] spawn_process: at 2018-10-30 23:15:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:15:24 [DEBUG   ] Got command RPT from MCS: ref #325804
2018-10-30 23:15:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325804  77 58421 83724089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:15:24 [DEBUG   ] Got command RPT from MCS: ref #325805
2018-10-30 23:15:24 [DEBUG   ] summary = ERROR
2018-10-30 23:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325805  13 58421 83724281 A  ERRORERROR'
2018-10-30 23:15:24 [DEBUG   ] Got command RPT from MCS: ref #325807
2018-10-30 23:15:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325807  77 58421 83724485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:15:24 [DEBUG   ] Got command RPT from MCS: ref #325809
2018-10-30 23:15:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325809  12 58421 83724689 A  ERRORBff'
2018-10-30 23:15:30 [DEBUG   ] Got command BAM from MCS: ref #325813
2018-10-30 23:15:30 [INFO    ] Finished processing BAM request
2018-10-30 23:15:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325813   8 58421 83730033 A  ERROR'
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:15:30 [DEBUG   ] spawn_process: at 2018-10-30 23:15:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:15:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:15:39 [DEBUG   ] Got command RPT from MCS: ref #325814
2018-10-30 23:15:39 [DEBUG   ] summary = ERROR
2018-10-30 23:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325814  13 58421 83739969 A  ERRORERROR'
2018-10-30 23:15:39 [DEBUG   ] Got command RPT from MCS: ref #325815
2018-10-30 23:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325815  77 58421 83739970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:15:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 23:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-30 23:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:15:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:15:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:15:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:15:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:15:57 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-30 23:16:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:16:31 [DEBUG   ] Got command BAM from MCS: ref #325835
2018-10-30 23:16:31 [INFO    ] Finished processing BAM request
2018-10-30 23:16:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325835   8 58421 83791033 A  ERROR'
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:16:31 [DEBUG   ] spawn_process: at 2018-10-30 23:16:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:16:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:16:45 [DEBUG   ] Got command BAM from MCS: ref #325836
2018-10-30 23:16:45 [INFO    ] Finished processing BAM request
2018-10-30 23:16:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325836   8 58421 83805033 A  ERROR'
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:16:45 [DEBUG   ] spawn_process: at 2018-10-30 23:16:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:16:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-30 23:16:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:16:57 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-10-30 23:17:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-30 23:17:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:17:38 [DEBUG   ] Got command BAM from MCS: ref #325837
2018-10-30 23:17:38 [INFO    ] Finished processing BAM request
2018-10-30 23:17:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325837   8 58421 83858033 A  ERROR'
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:17:38 [DEBUG   ] spawn_process: at 2018-10-30 23:17:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:17:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:17:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-30 23:17:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:17:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:17:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:17:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:17:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:17:57 [DEBUG   ] Finished updating board flags in 1.167 seconds
2018-10-30 23:17:59 [DEBUG   ] Got command BAM from MCS: ref #325838
2018-10-30 23:17:59 [INFO    ] Finished processing BAM request
2018-10-30 23:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325838   8 58421 83879025 A  ERROR'
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:17:59 [DEBUG   ] spawn_process: at 2018-10-30 23:17:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:18:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:18:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:18:44 [DEBUG   ] Got command BAM from MCS: ref #325839
2018-10-30 23:18:44 [INFO    ] Finished processing BAM request
2018-10-30 23:18:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325839   8 58421 83924029 A  ERROR'
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:18:44 [DEBUG   ] spawn_process: at 2018-10-30 23:18:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:18:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-30 23:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:18:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:18:57 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-10-30 23:19:11 [DEBUG   ] Got command BAM from MCS: ref #325844
2018-10-30 23:19:11 [INFO    ] Finished processing BAM request
2018-10-30 23:19:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325844   8 58421 83951033 A  ERROR'
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:19:11 [DEBUG   ] spawn_process: at 2018-10-30 23:19:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:19:14 [DEBUG   ] Got command BAM from MCS: ref #325846
2018-10-30 23:19:14 [INFO    ] Finished processing BAM request
2018-10-30 23:19:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325846   8 58421 83954025 A  ERROR'
2018-10-30 23:19:14 [DEBUG   ] Got command BAM from MCS: ref #325845
2018-10-30 23:19:14 [INFO    ] Finished processing BAM request
2018-10-30 23:19:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325845   8 58421 83954029 A  ERROR'
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:19:14 [DEBUG   ] spawn_process: at 2018-10-30 23:19:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:19:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:19:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:19:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:19:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:19:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:19:58 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-30 23:20:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:20:22 [DEBUG   ] Got command BAM from MCS: ref #325849
2018-10-30 23:20:22 [INFO    ] Finished processing BAM request
2018-10-30 23:20:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325849   8 58421 84022033 A  ERROR'
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:20:22 [DEBUG   ] spawn_process: at 2018-10-30 23:20:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:20:23 [DEBUG   ] Got command RPT from MCS: ref #325850
2018-10-30 23:20:23 [DEBUG   ] summary = ERROR
2018-10-30 23:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325850  13 58421 84023977 A  ERRORERROR'
2018-10-30 23:20:24 [DEBUG   ] Got command RPT from MCS: ref #325851
2018-10-30 23:20:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:20:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325851  77 58421 84024169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:20:24 [DEBUG   ] Got command RPT from MCS: ref #325852
2018-10-30 23:20:24 [DEBUG   ] summary = ERROR
2018-10-30 23:20:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325852  13 58421 84024373 A  ERRORERROR'
2018-10-30 23:20:24 [DEBUG   ] Got command RPT from MCS: ref #325853
2018-10-30 23:20:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:20:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325853  77 58421 84024577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:20:24 [DEBUG   ] Got command RPT from MCS: ref #325854
2018-10-30 23:20:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:20:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325854  12 58421 84024769 A  ERRORB˘ff'
2018-10-30 23:20:26 [DEBUG   ] Got command BAM from MCS: ref #325855
2018-10-30 23:20:26 [INFO    ] Finished processing BAM request
2018-10-30 23:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325855   8 58421 84026033 A  ERROR'
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:20:26 [DEBUG   ] spawn_process: at 2018-10-30 23:20:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:20:35 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-30 23:20:39 [DEBUG   ] Got command RPT from MCS: ref #325856
2018-10-30 23:20:39 [DEBUG   ] summary = ERROR
2018-10-30 23:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325856  13 58421 84039977 A  ERRORERROR'
2018-10-30 23:20:39 [DEBUG   ] Got command RPT from MCS: ref #325857
2018-10-30 23:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325857  77 58421 84039978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:20:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:20:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 23:20:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:20:57 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-10-30 23:21:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:21:30 [DEBUG   ] Got command BAM from MCS: ref #325873
2018-10-30 23:21:30 [INFO    ] Finished processing BAM request
2018-10-30 23:21:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325873   8 58421 84090029 A  ERROR'
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:21:30 [DEBUG   ] spawn_process: at 2018-10-30 23:21:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:21:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:21:38 [DEBUG   ] Got command BAM from MCS: ref #325874
2018-10-30 23:21:38 [INFO    ] Finished processing BAM request
2018-10-30 23:21:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325874   8 58421 84098033 A  ERROR'
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:21:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:21:38 [DEBUG   ] spawn_process: at 2018-10-30 23:21:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:21:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:21:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:21:57 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-10-30 23:22:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:22:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:22:38 [DEBUG   ] Got command BAM from MCS: ref #325879
2018-10-30 23:22:38 [INFO    ] Finished processing BAM request
2018-10-30 23:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325879   8 58421 84158025 A  ERROR'
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:22:38 [DEBUG   ] spawn_process: at 2018-10-30 23:22:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:22:50 [DEBUG   ] Got command BAM from MCS: ref #325880
2018-10-30 23:22:50 [INFO    ] Finished processing BAM request
2018-10-30 23:22:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:22:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325880   8 58421 84170025 A  ERROR'
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:22:50 [DEBUG   ] spawn_process: at 2018-10-30 23:22:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:22:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-30 23:22:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:22:57 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-10-30 23:23:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:23:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:23:46 [DEBUG   ] Got command BAM from MCS: ref #325881
2018-10-30 23:23:46 [INFO    ] Finished processing BAM request
2018-10-30 23:23:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325881   8 58421 84226029 A  ERROR'
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:23:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:23:46 [DEBUG   ] spawn_process: at 2018-10-30 23:23:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:23:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 23:23:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:23:57 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-10-30 23:24:02 [DEBUG   ] Got command BAM from MCS: ref #325882
2018-10-30 23:24:02 [INFO    ] Finished processing BAM request
2018-10-30 23:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325882   8 58421 84242025 A  ERROR'
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:24:02 [DEBUG   ] spawn_process: at 2018-10-30 23:24:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:24:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:24:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-30 23:24:54 [DEBUG   ] Got command BAM from MCS: ref #325887
2018-10-30 23:24:54 [INFO    ] Finished processing BAM request
2018-10-30 23:24:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325887   8 58421 84294025 A  ERROR'
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:24:54 [DEBUG   ] spawn_process: at 2018-10-30 23:24:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:24:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 23:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:24:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:24:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-30 23:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:24:57 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-10-30 23:25:14 [DEBUG   ] Got command BAM from MCS: ref #325890
2018-10-30 23:25:14 [INFO    ] Finished processing BAM request
2018-10-30 23:25:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325890   8 58421 84314025 A  ERROR'
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:25:14 [DEBUG   ] spawn_process: at 2018-10-30 23:25:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:25:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 23:25:24 [DEBUG   ] Got command RPT from MCS: ref #325891
2018-10-30 23:25:24 [DEBUG   ] summary = ERROR
2018-10-30 23:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325891  13 58421 84324053 A  ERRORERROR'
2018-10-30 23:25:24 [DEBUG   ] Got command RPT from MCS: ref #325892
2018-10-30 23:25:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325892  77 58421 84324257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:25:24 [DEBUG   ] Got command RPT from MCS: ref #325893
2018-10-30 23:25:24 [DEBUG   ] summary = ERROR
2018-10-30 23:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325893  13 58421 84324461 A  ERRORERROR'
2018-10-30 23:25:24 [DEBUG   ] Got command RPT from MCS: ref #325895
2018-10-30 23:25:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325895  77 58421 84324665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:25:24 [DEBUG   ] Got command RPT from MCS: ref #325896
2018-10-30 23:25:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325896  12 58421 84324857 A  ERRORB¤ff'
2018-10-30 23:25:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:25:39 [DEBUG   ] Got command RPT from MCS: ref #325901
2018-10-30 23:25:39 [DEBUG   ] summary = ERROR
2018-10-30 23:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325901  13 58421 84339977 A  ERRORERROR'
2018-10-30 23:25:39 [DEBUG   ] Got command RPT from MCS: ref #325902
2018-10-30 23:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325902  77 58421 84339978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:25:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 23:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 23:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:25:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:25:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:25:58 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-30 23:26:02 [DEBUG   ] Got command BAM from MCS: ref #325918
2018-10-30 23:26:02 [INFO    ] Finished processing BAM request
2018-10-30 23:26:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325918   8 58421 84362033 A  ERROR'
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:26:02 [DEBUG   ] spawn_process: at 2018-10-30 23:26:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:26:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:26:26 [DEBUG   ] Got command BAM from MCS: ref #325919
2018-10-30 23:26:26 [INFO    ] Finished processing BAM request
2018-10-30 23:26:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325919   8 58421 84386033 A  ERROR'
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:26:26 [DEBUG   ] spawn_process: at 2018-10-30 23:26:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:26:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:26:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-10-30 23:26:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:26:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:26:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:26:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:26:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:26:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:26:58 [DEBUG   ] Finished updating board flags in 1.248 seconds
2018-10-30 23:27:10 [DEBUG   ] Got command BAM from MCS: ref #325920
2018-10-30 23:27:10 [INFO    ] Finished processing BAM request
2018-10-30 23:27:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325920   8 58421 84430025 A  ERROR'
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:27:10 [DEBUG   ] spawn_process: at 2018-10-30 23:27:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:27:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 23:27:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-30 23:27:38 [DEBUG   ] Got command BAM from MCS: ref #325921
2018-10-30 23:27:38 [INFO    ] Finished processing BAM request
2018-10-30 23:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325921   8 58421 84458029 A  ERROR'
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:27:38 [DEBUG   ] spawn_process: at 2018-10-30 23:27:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:27:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-30 23:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:27:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:27:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:27:58 [DEBUG   ] Finished updating board flags in 1.240 seconds
2018-10-30 23:28:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-30 23:28:18 [DEBUG   ] Got command BAM from MCS: ref #325926
2018-10-30 23:28:18 [INFO    ] Finished processing BAM request
2018-10-30 23:28:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325926   8 58421 84498025 A  ERROR'
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:28:18 [DEBUG   ] spawn_process: at 2018-10-30 23:28:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:28:50 [DEBUG   ] Got command BAM from MCS: ref #325927
2018-10-30 23:28:50 [INFO    ] Finished processing BAM request
2018-10-30 23:28:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325927   8 58421 84530029 A  ERROR'
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:28:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:28:50 [DEBUG   ] spawn_process: at 2018-10-30 23:28:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:28:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:28:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:28:58 [DEBUG   ] Finished updating board flags in 1.118 seconds
2018-10-30 23:29:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:29:26 [DEBUG   ] Got command BAM from MCS: ref #325928
2018-10-30 23:29:26 [INFO    ] Finished processing BAM request
2018-10-30 23:29:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325928   8 58421 84566029 A  ERROR'
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:29:26 [DEBUG   ] spawn_process: at 2018-10-30 23:29:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:29:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-30 23:29:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-30 23:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 23:29:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:29:58 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-10-30 23:30:02 [DEBUG   ] Got command BAM from MCS: ref #325929
2018-10-30 23:30:02 [INFO    ] Finished processing BAM request
2018-10-30 23:30:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325929   8 58421 84602029 A  ERROR'
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:30:02 [DEBUG   ] spawn_process: at 2018-10-30 23:30:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:30:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-30 23:30:24 [DEBUG   ] Got command RPT from MCS: ref #325930
2018-10-30 23:30:24 [DEBUG   ] summary = ERROR
2018-10-30 23:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325930  13 58421 84624141 A  ERRORERROR'
2018-10-30 23:30:24 [DEBUG   ] Got command RPT from MCS: ref #325931
2018-10-30 23:30:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325931  77 58421 84624345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:30:24 [DEBUG   ] Got command RPT from MCS: ref #325932
2018-10-30 23:30:24 [DEBUG   ] summary = ERROR
2018-10-30 23:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325932  13 58421 84624549 A  ERRORERROR'
2018-10-30 23:30:24 [DEBUG   ] Got command RPT from MCS: ref #325933
2018-10-30 23:30:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325933  77 58421 84624753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:30:24 [DEBUG   ] Got command RPT from MCS: ref #325934
2018-10-30 23:30:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325934  12 58421 84624945 A  ERRORBŁff'
2018-10-30 23:30:34 [DEBUG   ] Got command BAM from MCS: ref #325935
2018-10-30 23:30:34 [INFO    ] Finished processing BAM request
2018-10-30 23:30:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325935   8 58421 84634025 A  ERROR'
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:30:34 [DEBUG   ] spawn_process: at 2018-10-30 23:30:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:30:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:30:39 [DEBUG   ] Got command RPT from MCS: ref #325936
2018-10-30 23:30:39 [DEBUG   ] summary = ERROR
2018-10-30 23:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325936  13 58421 84639973 A  ERRORERROR'
2018-10-30 23:30:39 [DEBUG   ] Got command RPT from MCS: ref #325937
2018-10-30 23:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325937  77 58421 84639974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:30:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:30:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:30:58 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-10-30 23:31:14 [DEBUG   ] Got command BAM from MCS: ref #325957
2018-10-30 23:31:14 [INFO    ] Finished processing BAM request
2018-10-30 23:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325957   8 58421 84674029 A  ERROR'
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:31:14 [DEBUG   ] spawn_process: at 2018-10-30 23:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:31:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:31:42 [DEBUG   ] Got command BAM from MCS: ref #325958
2018-10-30 23:31:42 [INFO    ] Finished processing BAM request
2018-10-30 23:31:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325958   8 58421 84702033 A  ERROR'
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:31:42 [DEBUG   ] spawn_process: at 2018-10-30 23:31:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:31:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:31:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:31:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:31:58 [DEBUG   ] Finished updating board flags in 1.262 seconds
2018-10-30 23:32:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:32:26 [DEBUG   ] Got command BAM from MCS: ref #325959
2018-10-30 23:32:26 [INFO    ] Finished processing BAM request
2018-10-30 23:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325959   8 58421 84746025 A  ERROR'
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:32:26 [DEBUG   ] spawn_process: at 2018-10-30 23:32:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:32:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:32:50 [DEBUG   ] Got command BAM from MCS: ref #325960
2018-10-30 23:32:50 [INFO    ] Finished processing BAM request
2018-10-30 23:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325960   8 58421 84770029 A  ERROR'
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:32:50 [DEBUG   ] spawn_process: at 2018-10-30 23:32:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:32:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-30 23:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:32:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:32:58 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-10-30 23:33:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:33:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:33:38 [DEBUG   ] Got command BAM from MCS: ref #325961
2018-10-30 23:33:38 [INFO    ] Finished processing BAM request
2018-10-30 23:33:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325961   8 58421 84818029 A  ERROR'
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:33:38 [DEBUG   ] spawn_process: at 2018-10-30 23:33:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:33:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:33:58 [DEBUG   ] Got command BAM from MCS: ref #325966
2018-10-30 23:33:58 [INFO    ] Finished processing BAM request
2018-10-30 23:33:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325966   8 58421 84838033 A  ERROR'
2018-10-30 23:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:33:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:33:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:33:58 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:33:58 [DEBUG   ] spawn_process: at 2018-10-30 23:33:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:34:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:34:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-30 23:34:50 [DEBUG   ] Got command BAM from MCS: ref #325967
2018-10-30 23:34:50 [INFO    ] Finished processing BAM request
2018-10-30 23:34:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325967   8 58421 84890025 A  ERROR'
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:34:50 [DEBUG   ] spawn_process: at 2018-10-30 23:34:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:34:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-30 23:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:34:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:34:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:34:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:34:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:34:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:34:58 [DEBUG   ] Finished updating board flags in 1.057 seconds
2018-10-30 23:35:06 [DEBUG   ] Got command BAM from MCS: ref #325970
2018-10-30 23:35:06 [INFO    ] Finished processing BAM request
2018-10-30 23:35:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325970   8 58421 84906033 A  ERROR'
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:35:06 [DEBUG   ] spawn_process: at 2018-10-30 23:35:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:35:16 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-30 23:35:24 [DEBUG   ] Got command RPT from MCS: ref #325971
2018-10-30 23:35:24 [DEBUG   ] summary = ERROR
2018-10-30 23:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325971  13 58421 84924233 A  ERRORERROR'
2018-10-30 23:35:24 [DEBUG   ] Got command RPT from MCS: ref #325972
2018-10-30 23:35:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325972  77 58421 84924437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:35:24 [DEBUG   ] Got command RPT from MCS: ref #325973
2018-10-30 23:35:24 [DEBUG   ] summary = ERROR
2018-10-30 23:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325973  13 58421 84924629 A  ERRORERROR'
2018-10-30 23:35:24 [DEBUG   ] Got command RPT from MCS: ref #325975
2018-10-30 23:35:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325975  77 58421 84924834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:35:25 [DEBUG   ] Got command RPT from MCS: ref #325977
2018-10-30 23:35:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325977  12 58421 84925037 A  ERRORB˘ff'
2018-10-30 23:35:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:35:39 [DEBUG   ] Got command RPT from MCS: ref #325981
2018-10-30 23:35:39 [DEBUG   ] summary = ERROR
2018-10-30 23:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325981  13 58421 84939985 A  ERRORERROR'
2018-10-30 23:35:39 [DEBUG   ] Got command RPT from MCS: ref #325982
2018-10-30 23:35:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   325982  77 58421 84939986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:35:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 23:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:35:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:35:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:35:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:35:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:35:58 [WARNING ] (13, 1, 'bot')
2018-10-30 23:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:35:58 [DEBUG   ] Finished updating board flags in 0.932 seconds
2018-10-30 23:36:02 [DEBUG   ] Got command BAM from MCS: ref #325998
2018-10-30 23:36:02 [INFO    ] Finished processing BAM request
2018-10-30 23:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325998   8 58421 84962033 A  ERROR'
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:36:02 [DEBUG   ] spawn_process: at 2018-10-30 23:36:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:36:14 [DEBUG   ] Got command BAM from MCS: ref #325999
2018-10-30 23:36:14 [INFO    ] Finished processing BAM request
2018-10-30 23:36:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:36:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   325999   8 58421 84974025 A  ERROR'
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:36:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:36:14 [DEBUG   ] spawn_process: at 2018-10-30 23:36:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:36:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:36:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:36:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:36:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:36:59 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-30 23:37:14 [DEBUG   ] Got command BAM from MCS: ref #326004
2018-10-30 23:37:14 [INFO    ] Finished processing BAM request
2018-10-30 23:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326004   8 58421 85034029 A  ERROR'
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:37:14 [DEBUG   ] spawn_process: at 2018-10-30 23:37:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:37:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:37:22 [DEBUG   ] Got command BAM from MCS: ref #326005
2018-10-30 23:37:22 [INFO    ] Finished processing BAM request
2018-10-30 23:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326005   8 58421 85042025 A  ERROR'
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:37:22 [DEBUG   ] spawn_process: at 2018-10-30 23:37:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:37:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:37:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:37:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:37:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:37:59 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-30 23:38:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:38:26 [DEBUG   ] Got command BAM from MCS: ref #326006
2018-10-30 23:38:26 [INFO    ] Finished processing BAM request
2018-10-30 23:38:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326006   8 58421 85106029 A  ERROR'
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:38:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:38:26 [DEBUG   ] spawn_process: at 2018-10-30 23:38:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:38:30 [DEBUG   ] Got command BAM from MCS: ref #326007
2018-10-30 23:38:30 [INFO    ] Finished processing BAM request
2018-10-30 23:38:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326007   8 58421 85110025 A  ERROR'
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:38:30 [DEBUG   ] spawn_process: at 2018-10-30 23:38:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:38:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:38:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:38:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:38:59 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-10-30 23:39:14 [DEBUG   ] Got command BAM from MCS: ref #326009
2018-10-30 23:39:14 [INFO    ] Finished processing BAM request
2018-10-30 23:39:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326009   8 58421 85154033 A  ERROR'
2018-10-30 23:39:14 [DEBUG   ] Got command BAM from MCS: ref #326008
2018-10-30 23:39:14 [INFO    ] Finished processing BAM request
2018-10-30 23:39:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326008   8 58421 85154037 A  ERROR'
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:39:14 [DEBUG   ] spawn_process: at 2018-10-30 23:39:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:39:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:39:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:39:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:39:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:39:59 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-10-30 23:40:04 [DEBUG   ] Got command BAM from MCS: ref #326016
2018-10-30 23:40:04 [INFO    ] Finished processing BAM request
2018-10-30 23:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326016   8 58421 85204029 A  ERROR'
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:40:04 [DEBUG   ] spawn_process: at 2018-10-30 23:40:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:40:07 [DEBUG   ] Got command BAM from MCS: ref #326017
2018-10-30 23:40:07 [INFO    ] Finished processing BAM request
2018-10-30 23:40:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326017   8 58421 85207025 A  ERROR'
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:40:07 [DEBUG   ] spawn_process: at 2018-10-30 23:40:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:40:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:40:24 [DEBUG   ] Got command RPT from MCS: ref #326018
2018-10-30 23:40:24 [DEBUG   ] summary = ERROR
2018-10-30 23:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326018  13 58421 85224313 A  ERRORERROR'
2018-10-30 23:40:24 [DEBUG   ] Got command RPT from MCS: ref #326019
2018-10-30 23:40:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326019  77 58421 85224517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:40:24 [DEBUG   ] Got command RPT from MCS: ref #326020
2018-10-30 23:40:24 [DEBUG   ] summary = ERROR
2018-10-30 23:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326020  13 58421 85224721 A  ERRORERROR'
2018-10-30 23:40:24 [DEBUG   ] Got command RPT from MCS: ref #326021
2018-10-30 23:40:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326021  77 58421 85224913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:40:25 [DEBUG   ] Got command RPT from MCS: ref #326022
2018-10-30 23:40:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326022  12 58421 85225117 A  ERRORB¤ff'
2018-10-30 23:40:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:40:39 [DEBUG   ] Got command RPT from MCS: ref #326023
2018-10-30 23:40:39 [DEBUG   ] summary = ERROR
2018-10-30 23:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326023  13 58421 85239977 A  ERRORERROR'
2018-10-30 23:40:39 [DEBUG   ] Got command RPT from MCS: ref #326024
2018-10-30 23:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326024  77 58421 85239978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:40:54 [DEBUG   ] Got command BAM from MCS: ref #326040
2018-10-30 23:40:54 [INFO    ] Finished processing BAM request
2018-10-30 23:40:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326040   8 58421 85254033 A  ERROR'
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:40:54 [DEBUG   ] spawn_process: at 2018-10-30 23:40:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:40:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:40:59 [DEBUG   ] Got command BAM from MCS: ref #326041
2018-10-30 23:40:59 [INFO    ] Finished processing BAM request
2018-10-30 23:40:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326041   8 58421 85259033 A  ERROR'
2018-10-30 23:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:40:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:40:59 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:40:59 [DEBUG   ] spawn_process: at 2018-10-30 23:40:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:41:14 [DEBUG   ] Got command BAM from MCS: ref #326042
2018-10-30 23:41:14 [INFO    ] Finished processing BAM request
2018-10-30 23:41:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326042   8 58421 85274029 A  ERROR'
2018-10-30 23:41:14 [DEBUG   ] Got command BAM from MCS: ref #326043
2018-10-30 23:41:14 [INFO    ] Finished processing BAM request
2018-10-30 23:41:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326043   8 58421 85274033 A  ERROR'
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:41:14 [DEBUG   ] spawn_process: at 2018-10-30 23:41:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:41:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:41:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:41:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 23:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:42:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:42:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:42:00 [DEBUG   ] Finished updating board flags in 1.929 seconds
2018-10-30 23:42:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:42:22 [DEBUG   ] Got command BAM from MCS: ref #326046
2018-10-30 23:42:22 [INFO    ] Finished processing BAM request
2018-10-30 23:42:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326046   8 58421 85342029 A  ERROR'
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:42:22 [DEBUG   ] spawn_process: at 2018-10-30 23:42:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:42:26 [DEBUG   ] Got command BAM from MCS: ref #326047
2018-10-30 23:42:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326047   8 58421 85346025 A  ERROR'
2018-10-30 23:42:26 [INFO    ] Finished processing BAM request
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:42:26 [DEBUG   ] spawn_process: at 2018-10-30 23:42:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:42:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:42:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:42:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:42:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:42:59 [DEBUG   ] Finished updating board flags in 1.273 seconds
2018-10-30 23:43:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:43:30 [DEBUG   ] Got command BAM from MCS: ref #326052
2018-10-30 23:43:30 [INFO    ] Finished processing BAM request
2018-10-30 23:43:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326052   8 58421 85410029 A  ERROR'
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:43:30 [DEBUG   ] spawn_process: at 2018-10-30 23:43:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:43:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:43:38 [DEBUG   ] Got command BAM from MCS: ref #326053
2018-10-30 23:43:38 [INFO    ] Finished processing BAM request
2018-10-30 23:43:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326053   8 58421 85418033 A  ERROR'
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:43:38 [DEBUG   ] spawn_process: at 2018-10-30 23:43:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:43:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:44:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:44:00 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-10-30 23:44:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:44:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:44:38 [DEBUG   ] Got command BAM from MCS: ref #326054
2018-10-30 23:44:38 [INFO    ] Finished processing BAM request
2018-10-30 23:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326054   8 58421 85478033 A  ERROR'
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:44:38 [DEBUG   ] spawn_process: at 2018-10-30 23:44:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:44:50 [DEBUG   ] Got command BAM from MCS: ref #326055
2018-10-30 23:44:50 [INFO    ] Finished processing BAM request
2018-10-30 23:44:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326055   8 58421 85490025 A  ERROR'
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:44:50 [DEBUG   ] spawn_process: at 2018-10-30 23:44:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:44:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:44:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:44:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:59 [WARNING ] (13, 1, 'bot')
2018-10-30 23:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:44:59 [DEBUG   ] Finished updating board flags in 0.966 seconds
2018-10-30 23:45:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-30 23:45:24 [DEBUG   ] Got command RPT from MCS: ref #326058
2018-10-30 23:45:24 [DEBUG   ] summary = ERROR
2018-10-30 23:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326058  13 58421 85524401 A  ERRORERROR'
2018-10-30 23:45:24 [DEBUG   ] Got command RPT from MCS: ref #326059
2018-10-30 23:45:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326059  77 58421 85524593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:45:24 [DEBUG   ] Got command RPT from MCS: ref #326060
2018-10-30 23:45:24 [DEBUG   ] summary = ERROR
2018-10-30 23:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326060  13 58421 85524797 A  ERRORERROR'
2018-10-30 23:45:25 [DEBUG   ] Got command RPT from MCS: ref #326062
2018-10-30 23:45:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326062  77 58421 85525001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:45:25 [DEBUG   ] Got command RPT from MCS: ref #326063
2018-10-30 23:45:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326063  12 58421 85525205 A  ERRORB¤ff'
2018-10-30 23:45:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:45:39 [DEBUG   ] Got command RPT from MCS: ref #326068
2018-10-30 23:45:39 [DEBUG   ] summary = ERROR
2018-10-30 23:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326068  13 58421 85539981 A  ERRORERROR'
2018-10-30 23:45:39 [DEBUG   ] Got command RPT from MCS: ref #326069
2018-10-30 23:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326069  77 58421 85539982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:45:46 [DEBUG   ] Got command BAM from MCS: ref #326089
2018-10-30 23:45:46 [INFO    ] Finished processing BAM request
2018-10-30 23:45:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:45:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326089   8 58421 85546033 A  ERROR'
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:45:46 [DEBUG   ] spawn_process: at 2018-10-30 23:45:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:45:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-30 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 23:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-30 23:46:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:46:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:46:00 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-30 23:46:02 [DEBUG   ] Got command BAM from MCS: ref #326090
2018-10-30 23:46:02 [INFO    ] Finished processing BAM request
2018-10-30 23:46:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326090   8 58421 85562033 A  ERROR'
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:46:02 [DEBUG   ] spawn_process: at 2018-10-30 23:46:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:46:16 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-30 23:46:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:46:54 [DEBUG   ] Got command BAM from MCS: ref #326091
2018-10-30 23:46:54 [INFO    ] Finished processing BAM request
2018-10-30 23:46:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326091   8 58421 85614033 A  ERROR'
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:46:54 [DEBUG   ] spawn_process: at 2018-10-30 23:46:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:46:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:47:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:47:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:47:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:47:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:47:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:47:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:47:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:47:00 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-10-30 23:47:14 [DEBUG   ] Got command BAM from MCS: ref #326092
2018-10-30 23:47:14 [INFO    ] Finished processing BAM request
2018-10-30 23:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326092   8 58421 85634033 A  ERROR'
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:47:14 [DEBUG   ] spawn_process: at 2018-10-30 23:47:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:47:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:47:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:47:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 23:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:48:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:48:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:48:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:48:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:48:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:48:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:48:00 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-10-30 23:48:02 [DEBUG   ] Got command BAM from MCS: ref #326093
2018-10-30 23:48:02 [INFO    ] Finished processing BAM request
2018-10-30 23:48:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326093   8 58421 85682029 A  ERROR'
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:48:02 [DEBUG   ] spawn_process: at 2018-10-30 23:48:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:48:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:48:25 [DEBUG   ] Got command BAM from MCS: ref #326094
2018-10-30 23:48:25 [INFO    ] Finished processing BAM request
2018-10-30 23:48:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326094   8 58421 85705029 A  ERROR'
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:48:25 [DEBUG   ] spawn_process: at 2018-10-30 23:48:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:48:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:48:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:48:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:49:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:49:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:49:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:49:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:49:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:49:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:49:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:49:00 [DEBUG   ] Finished updating board flags in 1.070 seconds
2018-10-30 23:49:10 [DEBUG   ] Got command BAM from MCS: ref #326099
2018-10-30 23:49:10 [INFO    ] Finished processing BAM request
2018-10-30 23:49:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326099   8 58421 85750029 A  ERROR'
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:49:10 [DEBUG   ] spawn_process: at 2018-10-30 23:49:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:49:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:49:36 [DEBUG   ] Got command BAM from MCS: ref #326100
2018-10-30 23:49:36 [INFO    ] Finished processing BAM request
2018-10-30 23:49:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326100   8 58421 85776025 A  ERROR'
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:49:36 [DEBUG   ] spawn_process: at 2018-10-30 23:49:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:49:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:49:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:50:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:50:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:50:01 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-10-30 23:50:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:50:18 [DEBUG   ] Got command BAM from MCS: ref #326101
2018-10-30 23:50:18 [INFO    ] Finished processing BAM request
2018-10-30 23:50:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326101   8 58421 85818033 A  ERROR'
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:50:18 [DEBUG   ] spawn_process: at 2018-10-30 23:50:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:50:24 [DEBUG   ] Got command RPT from MCS: ref #326102
2018-10-30 23:50:24 [DEBUG   ] summary = ERROR
2018-10-30 23:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326102  13 58421 85824481 A  ERRORERROR'
2018-10-30 23:50:24 [DEBUG   ] Got command RPT from MCS: ref #326103
2018-10-30 23:50:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326103  77 58421 85824685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:50:24 [DEBUG   ] Got command RPT from MCS: ref #326104
2018-10-30 23:50:24 [DEBUG   ] summary = ERROR
2018-10-30 23:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326104  13 58421 85824877 A  ERRORERROR'
2018-10-30 23:50:25 [DEBUG   ] Got command RPT from MCS: ref #326105
2018-10-30 23:50:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326105  77 58421 85825081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:50:25 [DEBUG   ] Got command RPT from MCS: ref #326106
2018-10-30 23:50:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326106  12 58421 85825285 A  ERRORBŁff'
2018-10-30 23:50:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:50:39 [DEBUG   ] Got command RPT from MCS: ref #326107
2018-10-30 23:50:39 [DEBUG   ] summary = ERROR
2018-10-30 23:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326107  13 58421 85839989 A  ERRORERROR'
2018-10-30 23:50:39 [DEBUG   ] Got command RPT from MCS: ref #326108
2018-10-30 23:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326108  77 58421 85839990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:50:47 [DEBUG   ] Got command BAM from MCS: ref #326124
2018-10-30 23:50:47 [INFO    ] Finished processing BAM request
2018-10-30 23:50:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:50:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326124   8 58421 85847025 A  ERROR'
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:50:47 [DEBUG   ] spawn_process: at 2018-10-30 23:50:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:50:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-30 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 23:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:51:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:51:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:51:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:51:01 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-30 23:51:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:51:26 [DEBUG   ] Got command BAM from MCS: ref #326125
2018-10-30 23:51:26 [INFO    ] Finished processing BAM request
2018-10-30 23:51:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326125   8 58421 85886029 A  ERROR'
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:51:26 [DEBUG   ] spawn_process: at 2018-10-30 23:51:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:51:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:51:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:51:58 [DEBUG   ] Got command BAM from MCS: ref #326130
2018-10-30 23:51:58 [INFO    ] Finished processing BAM request
2018-10-30 23:51:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326130   8 58421 85918025 A  ERROR'
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:51:58 [DEBUG   ] spawn_process: at 2018-10-30 23:51:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-30 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-30 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-30 23:52:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:52:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:52:00 [DEBUG   ] Finished updating board flags in 1.150 seconds
2018-10-30 23:52:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:52:34 [DEBUG   ] Got command BAM from MCS: ref #326131
2018-10-30 23:52:34 [INFO    ] Finished processing BAM request
2018-10-30 23:52:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326131   8 58421 85954029 A  ERROR'
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:52:34 [DEBUG   ] spawn_process: at 2018-10-30 23:52:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:52:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:52:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-30 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:53:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:53:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:53:00 [DEBUG   ] Finished updating board flags in 1.042 seconds
2018-10-30 23:53:09 [DEBUG   ] Got command BAM from MCS: ref #326132
2018-10-30 23:53:09 [INFO    ] Finished processing BAM request
2018-10-30 23:53:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326132   8 58421 85989033 A  ERROR'
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:53:09 [DEBUG   ] spawn_process: at 2018-10-30 23:53:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:53:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:53:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:53:42 [DEBUG   ] Got command BAM from MCS: ref #326133
2018-10-30 23:53:42 [INFO    ] Finished processing BAM request
2018-10-30 23:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326133   8 58421 86022025 A  ERROR'
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:53:42 [DEBUG   ] spawn_process: at 2018-10-30 23:53:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:53:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:54:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:54:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:54:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-30 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:54:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-30 23:54:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:54:20 [DEBUG   ] Got command BAM from MCS: ref #326134
2018-10-30 23:54:20 [INFO    ] Finished processing BAM request
2018-10-30 23:54:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326134   8 58421 86060033 A  ERROR'
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:54:20 [DEBUG   ] spawn_process: at 2018-10-30 23:54:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:54:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:54:50 [DEBUG   ] Got command BAM from MCS: ref #326139
2018-10-30 23:54:50 [INFO    ] Finished processing BAM request
2018-10-30 23:54:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326139   8 58421 86090033 A  ERROR'
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:54:50 [DEBUG   ] spawn_process: at 2018-10-30 23:54:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:54:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:55:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:55:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:55:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:55:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:55:00 [WARNING ] (13, 1, 'bot')
2018-10-30 23:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:55:00 [DEBUG   ] Finished updating board flags in 0.962 seconds
2018-10-30 23:55:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:55:24 [DEBUG   ] Got command RPT from MCS: ref #326142
2018-10-30 23:55:24 [DEBUG   ] summary = ERROR
2018-10-30 23:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326142  13 58421 86124573 A  ERRORERROR'
2018-10-30 23:55:24 [DEBUG   ] Got command RPT from MCS: ref #326143
2018-10-30 23:55:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326143  77 58421 86124765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:55:24 [DEBUG   ] Got command RPT from MCS: ref #326144
2018-10-30 23:55:24 [DEBUG   ] summary = ERROR
2018-10-30 23:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326144  13 58421 86124969 A  ERRORERROR'
2018-10-30 23:55:25 [DEBUG   ] Got command RPT from MCS: ref #326146
2018-10-30 23:55:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326146  77 58421 86125173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:55:25 [DEBUG   ] Got command RPT from MCS: ref #326147
2018-10-30 23:55:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-30 23:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326147  12 58421 86125377 A  ERRORBŁff'
2018-10-30 23:55:31 [DEBUG   ] Got command BAM from MCS: ref #326152
2018-10-30 23:55:31 [INFO    ] Finished processing BAM request
2018-10-30 23:55:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326152   8 58421 86131033 A  ERROR'
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:55:31 [DEBUG   ] spawn_process: at 2018-10-30 23:55:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:55:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:55:39 [DEBUG   ] Got command RPT from MCS: ref #326153
2018-10-30 23:55:39 [DEBUG   ] summary = ERROR
2018-10-30 23:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326153  13 58421 86139989 A  ERRORERROR'
2018-10-30 23:55:39 [DEBUG   ] Got command RPT from MCS: ref #326154
2018-10-30 23:55:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-30 23:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326154  77 58421 86139990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-30 23:55:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:55:58 [DEBUG   ] Got command BAM from MCS: ref #326170
2018-10-30 23:55:58 [INFO    ] Finished processing BAM request
2018-10-30 23:55:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326170   8 58421 86158029 A  ERROR'
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-30 23:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-30 23:55:58 [DEBUG   ] spawn_process: at 2018-10-30 23:55:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-30 23:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:56:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-30 23:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:56:01 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-30 23:56:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:56:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:56:42 [DEBUG   ] Got command BAM from MCS: ref #326171
2018-10-30 23:56:42 [INFO    ] Finished processing BAM request
2018-10-30 23:56:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326171   8 58421 86202025 A  ERROR'
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:56:42 [DEBUG   ] spawn_process: at 2018-10-30 23:56:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:56:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-30 23:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-30 23:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-30 23:57:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:57:01 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-10-30 23:57:06 [DEBUG   ] Got command BAM from MCS: ref #326172
2018-10-30 23:57:06 [INFO    ] Finished processing BAM request
2018-10-30 23:57:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:57:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326172   8 58421 86226033 A  ERROR'
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-30 23:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-30 23:57:06 [DEBUG   ] spawn_process: at 2018-10-30 23:57:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-30 23:57:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:57:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:57:53 [DEBUG   ] Got command BAM from MCS: ref #326177
2018-10-30 23:57:53 [INFO    ] Finished processing BAM request
2018-10-30 23:57:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:57:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326177   8 58421 86273033 A  ERROR'
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:57:53 [DEBUG   ] spawn_process: at 2018-10-30 23:57:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:57:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-30 23:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-30 23:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:58:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:58:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-30 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:58:01 [DEBUG   ] Finished updating board flags in 1.127 seconds
2018-10-30 23:58:14 [DEBUG   ] Got command BAM from MCS: ref #326178
2018-10-30 23:58:14 [INFO    ] Finished processing BAM request
2018-10-30 23:58:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326178   8 58421 86294025 A  ERROR'
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-30 23:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-30 23:58:14 [DEBUG   ] spawn_process: at 2018-10-30 23:58:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-30 23:58:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:58:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:58:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-30 23:59:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-30 23:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-30 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-30 23:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-30 23:59:01 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-30 23:59:04 [DEBUG   ] Got command BAM from MCS: ref #326179
2018-10-30 23:59:04 [INFO    ] Finished processing BAM request
2018-10-30 23:59:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326179   8 58421 86344029 A  ERROR'
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-30 23:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-30 23:59:04 [DEBUG   ] spawn_process: at 2018-10-30 23:59:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-30 23:59:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:59:22 [DEBUG   ] Got command BAM from MCS: ref #326180
2018-10-30 23:59:22 [INFO    ] Finished processing BAM request
2018-10-30 23:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-30 23:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326180   8 58421 86362029 A  ERROR'
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-30 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-30 23:59:22 [DEBUG   ] spawn_process: at 2018-10-30 23:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-30 23:59:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-30 23:59:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:00:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:00:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:00:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:00:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:00:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:00:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:00:01 [DEBUG   ] Finished updating board flags in 1.044 seconds
2018-10-31 00:00:15 [DEBUG   ] Got command BAM from MCS: ref #326181
2018-10-31 00:00:15 [INFO    ] Finished processing BAM request
2018-10-31 00:00:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326181   8 58422    15025 A  ERROR'
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:00:15 [DEBUG   ] spawn_process: at 2018-10-31 00:00:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:00:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:00:24 [DEBUG   ] Got command RPT from MCS: ref #326182
2018-10-31 00:00:24 [DEBUG   ] summary = ERROR
2018-10-31 00:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326182  13 58422    24665 A  ERRORERROR'
2018-10-31 00:00:24 [DEBUG   ] Got command RPT from MCS: ref #326183
2018-10-31 00:00:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326183  77 58422    24857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:00:25 [DEBUG   ] Got command RPT from MCS: ref #326184
2018-10-31 00:00:25 [DEBUG   ] summary = ERROR
2018-10-31 00:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326184  13 58422    25061 A  ERRORERROR'
2018-10-31 00:00:25 [DEBUG   ] Got command RPT from MCS: ref #326185
2018-10-31 00:00:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326185  77 58422    25265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:00:25 [DEBUG   ] Got command RPT from MCS: ref #326186
2018-10-31 00:00:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326186  12 58422    25457 A  ERRORB¤ff'
2018-10-31 00:00:30 [DEBUG   ] Got command BAM from MCS: ref #326187
2018-10-31 00:00:30 [INFO    ] Finished processing BAM request
2018-10-31 00:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326187   8 58422    30033 A  ERROR'
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:00:30 [DEBUG   ] spawn_process: at 2018-10-31 00:00:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:00:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:00:39 [DEBUG   ] Got command RPT from MCS: ref #326188
2018-10-31 00:00:39 [DEBUG   ] summary = ERROR
2018-10-31 00:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326188  13 58422    39985 A  ERRORERROR'
2018-10-31 00:00:39 [DEBUG   ] Got command RPT from MCS: ref #326189
2018-10-31 00:00:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326189  77 58422    39986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:00:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-31 00:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:01:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:01:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:01:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:01:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:01:02 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-31 00:01:14 [DEBUG   ] Got command BAM from MCS: ref #326210
2018-10-31 00:01:14 [INFO    ] Finished processing BAM request
2018-10-31 00:01:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326210   8 58422    74033 A  ERROR'
2018-10-31 00:01:14 [DEBUG   ] Got command BAM from MCS: ref #326209
2018-10-31 00:01:14 [INFO    ] Finished processing BAM request
2018-10-31 00:01:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326209   8 58422    74037 A  ERROR'
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:01:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:01:14 [DEBUG   ] spawn_process: at 2018-10-31 00:01:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:01:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:01:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:01:53 [DEBUG   ] Got command BAM from MCS: ref #326213
2018-10-31 00:01:53 [INFO    ] Finished processing BAM request
2018-10-31 00:01:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326213   8 58422   113033 A  ERROR'
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:01:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:01:53 [DEBUG   ] spawn_process: at 2018-10-31 00:01:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:01:54 [DEBUG   ] Got command BAM from MCS: ref #326214
2018-10-31 00:01:54 [INFO    ] Finished processing BAM request
2018-10-31 00:01:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326214   8 58422   114033 A  ERROR'
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:01:54 [DEBUG   ] spawn_process: at 2018-10-31 00:01:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:01:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:02:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:02:01 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-10-31 00:02:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:02:32 [DEBUG   ] Got command BAM from MCS: ref #326215
2018-10-31 00:02:32 [INFO    ] Finished processing BAM request
2018-10-31 00:02:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326215   8 58422   152033 A  ERROR'
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:02:32 [DEBUG   ] spawn_process: at 2018-10-31 00:02:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:02:34 [DEBUG   ] Got command BAM from MCS: ref #326216
2018-10-31 00:02:34 [INFO    ] Finished processing BAM request
2018-10-31 00:02:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326216   8 58422   154033 A  ERROR'
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:02:34 [DEBUG   ] spawn_process: at 2018-10-31 00:02:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:02:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:02:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:03:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:03:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:03:01 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-10-31 00:03:11 [DEBUG   ] Got command BAM from MCS: ref #326217
2018-10-31 00:03:11 [INFO    ] Finished processing BAM request
2018-10-31 00:03:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326217   8 58422   191025 A  ERROR'
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:03:11 [DEBUG   ] spawn_process: at 2018-10-31 00:03:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:03:13 [DEBUG   ] Got command BAM from MCS: ref #326218
2018-10-31 00:03:13 [INFO    ] Finished processing BAM request
2018-10-31 00:03:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326218   8 58422   193033 A  ERROR'
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:03:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:03:13 [DEBUG   ] spawn_process: at 2018-10-31 00:03:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:03:14 [DEBUG   ] Got command BAM from MCS: ref #326219
2018-10-31 00:03:14 [INFO    ] Finished processing BAM request
2018-10-31 00:03:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326219   8 58422   194033 A  ERROR'
2018-10-31 00:03:14 [DEBUG   ] Got command BAM from MCS: ref #326220
2018-10-31 00:03:14 [INFO    ] Finished processing BAM request
2018-10-31 00:03:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326220   8 58422   194037 A  ERROR'
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:03:14 [DEBUG   ] spawn_process: at 2018-10-31 00:03:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:03:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:03:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:03:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 00:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:04:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:04:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:04:01 [DEBUG   ] Finished updating board flags in 1.261 seconds
2018-10-31 00:04:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:04:22 [DEBUG   ] Got command BAM from MCS: ref #326227
2018-10-31 00:04:22 [INFO    ] Finished processing BAM request
2018-10-31 00:04:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326227   8 58422   262033 A  ERROR'
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:04:22 [DEBUG   ] spawn_process: at 2018-10-31 00:04:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:04:25 [DEBUG   ] Got command BAM from MCS: ref #326228
2018-10-31 00:04:25 [INFO    ] Finished processing BAM request
2018-10-31 00:04:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326228   8 58422   265029 A  ERROR'
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:04:25 [DEBUG   ] spawn_process: at 2018-10-31 00:04:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:04:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:04:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 00:05:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:05:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-31 00:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:05:01 [DEBUG   ] Finished updating board flags in 1.122 seconds
2018-10-31 00:05:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:05:24 [DEBUG   ] Got command RPT from MCS: ref #326231
2018-10-31 00:05:24 [DEBUG   ] summary = ERROR
2018-10-31 00:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326231  13 58422   324745 A  ERRORERROR'
2018-10-31 00:05:24 [DEBUG   ] Got command RPT from MCS: ref #326232
2018-10-31 00:05:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326232  77 58422   324949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:05:25 [DEBUG   ] Got command RPT from MCS: ref #326233
2018-10-31 00:05:25 [DEBUG   ] summary = ERROR
2018-10-31 00:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326233  13 58422   325153 A  ERRORERROR'
2018-10-31 00:05:25 [DEBUG   ] Got command RPT from MCS: ref #326235
2018-10-31 00:05:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326235  77 58422   325345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:05:25 [DEBUG   ] Got command RPT from MCS: ref #326236
2018-10-31 00:05:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326236  12 58422   325549 A  ERRORB¤ff'
2018-10-31 00:05:30 [DEBUG   ] Got command BAM from MCS: ref #326241
2018-10-31 00:05:30 [INFO    ] Finished processing BAM request
2018-10-31 00:05:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326241   8 58422   330029 A  ERROR'
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:05:30 [DEBUG   ] spawn_process: at 2018-10-31 00:05:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:05:36 [DEBUG   ] Got command BAM from MCS: ref #326242
2018-10-31 00:05:36 [INFO    ] Finished processing BAM request
2018-10-31 00:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326242   8 58422   336033 A  ERROR'
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:05:36 [DEBUG   ] spawn_process: at 2018-10-31 00:05:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:05:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:05:39 [DEBUG   ] Got command RPT from MCS: ref #326243
2018-10-31 00:05:39 [DEBUG   ] summary = ERROR
2018-10-31 00:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326243  13 58422   339985 A  ERRORERROR'
2018-10-31 00:05:39 [DEBUG   ] Got command RPT from MCS: ref #326244
2018-10-31 00:05:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326244  77 58422   339986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:05:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:06:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:06:02 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-10-31 00:06:17 [DEBUG   ] Finished updating ant stats in 1.179 seconds
2018-10-31 00:06:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:06:38 [DEBUG   ] Got command BAM from MCS: ref #326260
2018-10-31 00:06:38 [INFO    ] Finished processing BAM request
2018-10-31 00:06:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326260   8 58422   398025 A  ERROR'
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:06:38 [DEBUG   ] spawn_process: at 2018-10-31 00:06:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:06:47 [DEBUG   ] Got command BAM from MCS: ref #326265
2018-10-31 00:06:47 [INFO    ] Finished processing BAM request
2018-10-31 00:06:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326265   8 58422   407029 A  ERROR'
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:06:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:06:47 [DEBUG   ] spawn_process: at 2018-10-31 00:06:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:06:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 00:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 00:07:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:07:02 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-31 00:07:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 00:07:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 00:07:46 [DEBUG   ] Got command BAM from MCS: ref #326266
2018-10-31 00:07:46 [INFO    ] Finished processing BAM request
2018-10-31 00:07:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:07:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326266   8 58422   466033 A  ERROR'
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:07:46 [DEBUG   ] spawn_process: at 2018-10-31 00:07:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:07:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 00:07:58 [DEBUG   ] Got command BAM from MCS: ref #326267
2018-10-31 00:07:58 [INFO    ] Finished processing BAM request
2018-10-31 00:07:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:07:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326267   8 58422   478033 A  ERROR'
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:07:58 [DEBUG   ] spawn_process: at 2018-10-31 00:07:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-31 00:08:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:08:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:08:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:08:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:08:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:08:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:08:02 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-10-31 00:08:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 00:08:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:08:54 [DEBUG   ] Got command BAM from MCS: ref #326268
2018-10-31 00:08:54 [INFO    ] Finished processing BAM request
2018-10-31 00:08:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326268   8 58422   534025 A  ERROR'
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:08:54 [DEBUG   ] spawn_process: at 2018-10-31 00:08:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:08:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:09:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:09:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:09:02 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-31 00:09:09 [DEBUG   ] Got command BAM from MCS: ref #326269
2018-10-31 00:09:09 [INFO    ] Finished processing BAM request
2018-10-31 00:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326269   8 58422   549025 A  ERROR'
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:09:09 [DEBUG   ] spawn_process: at 2018-10-31 00:09:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:09:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:09:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 00:09:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 00:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:10:02 [DEBUG   ] Got command BAM from MCS: ref #326274
2018-10-31 00:10:02 [INFO    ] Finished processing BAM request
2018-10-31 00:10:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326274   8 58422   602029 A  ERROR'
2018-10-31 00:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 00:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 00:10:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:10:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:10:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:10:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:10:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:10:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:10:02 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:10:02 [DEBUG   ] spawn_process: at 2018-10-31 00:10:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:10:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:10:20 [DEBUG   ] Got command BAM from MCS: ref #326275
2018-10-31 00:10:20 [INFO    ] Finished processing BAM request
2018-10-31 00:10:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326275   8 58422   620033 A  ERROR'
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:10:20 [DEBUG   ] spawn_process: at 2018-10-31 00:10:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:10:24 [DEBUG   ] Got command RPT from MCS: ref #326276
2018-10-31 00:10:24 [DEBUG   ] summary = ERROR
2018-10-31 00:10:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326276  13 58422   624833 A  ERRORERROR'
2018-10-31 00:10:25 [DEBUG   ] Got command RPT from MCS: ref #326277
2018-10-31 00:10:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326277  77 58422   625037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:10:25 [DEBUG   ] Got command RPT from MCS: ref #326278
2018-10-31 00:10:25 [DEBUG   ] summary = ERROR
2018-10-31 00:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326278  13 58422   625241 A  ERRORERROR'
2018-10-31 00:10:25 [DEBUG   ] Got command RPT from MCS: ref #326279
2018-10-31 00:10:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326279  77 58422   625433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:10:25 [DEBUG   ] Got command RPT from MCS: ref #326280
2018-10-31 00:10:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326280  12 58422   625637 A  ERRORBŁff'
2018-10-31 00:10:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:10:39 [DEBUG   ] Got command RPT from MCS: ref #326281
2018-10-31 00:10:39 [DEBUG   ] summary = ERROR
2018-10-31 00:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326281  13 58422   639993 A  ERRORERROR'
2018-10-31 00:10:39 [DEBUG   ] Got command RPT from MCS: ref #326282
2018-10-31 00:10:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326282  77 58422   639994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:10:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 00:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 00:11:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:11:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:11:02 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-10-31 00:11:10 [DEBUG   ] Got command BAM from MCS: ref #326298
2018-10-31 00:11:10 [INFO    ] Finished processing BAM request
2018-10-31 00:11:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:11:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326298   8 58422   670029 A  ERROR'
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:11:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:11:10 [DEBUG   ] spawn_process: at 2018-10-31 00:11:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:11:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:11:31 [DEBUG   ] Got command BAM from MCS: ref #326299
2018-10-31 00:11:31 [INFO    ] Finished processing BAM request
2018-10-31 00:11:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326299   8 58422   691033 A  ERROR'
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:11:31 [DEBUG   ] spawn_process: at 2018-10-31 00:11:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:11:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:11:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:12:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:12:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:12:02 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-10-31 00:12:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:12:18 [DEBUG   ] Got command BAM from MCS: ref #326300
2018-10-31 00:12:18 [INFO    ] Finished processing BAM request
2018-10-31 00:12:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326300   8 58422   738029 A  ERROR'
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:12:18 [DEBUG   ] spawn_process: at 2018-10-31 00:12:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:12:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:12:42 [DEBUG   ] Got command BAM from MCS: ref #326301
2018-10-31 00:12:42 [INFO    ] Finished processing BAM request
2018-10-31 00:12:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326301   8 58422   762029 A  ERROR'
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:12:42 [DEBUG   ] spawn_process: at 2018-10-31 00:12:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:12:57 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2018-10-31 00:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:13:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:13:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:13:02 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-10-31 00:13:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:13:26 [DEBUG   ] Got command BAM from MCS: ref #326306
2018-10-31 00:13:26 [INFO    ] Finished processing BAM request
2018-10-31 00:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326306   8 58422   806025 A  ERROR'
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:13:26 [DEBUG   ] spawn_process: at 2018-10-31 00:13:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:13:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:13:53 [DEBUG   ] Got command BAM from MCS: ref #326307
2018-10-31 00:13:53 [INFO    ] Finished processing BAM request
2018-10-31 00:13:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326307   8 58422   833033 A  ERROR'
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:13:53 [DEBUG   ] spawn_process: at 2018-10-31 00:13:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:13:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:14:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:14:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:14:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:14:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:14:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:14:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:14:02 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-10-31 00:14:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:14:34 [DEBUG   ] Got command BAM from MCS: ref #326308
2018-10-31 00:14:34 [INFO    ] Finished processing BAM request
2018-10-31 00:14:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326308   8 58422   874025 A  ERROR'
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:14:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:14:34 [DEBUG   ] spawn_process: at 2018-10-31 00:14:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:14:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:14:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:15:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:15:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:15:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:15:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:15:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:15:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:15:02 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-31 00:15:04 [DEBUG   ] Got command BAM from MCS: ref #326311
2018-10-31 00:15:04 [INFO    ] Finished processing BAM request
2018-10-31 00:15:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326311   8 58422   904029 A  ERROR'
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:15:04 [DEBUG   ] spawn_process: at 2018-10-31 00:15:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:15:17 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 00:15:24 [DEBUG   ] Got command RPT from MCS: ref #326312
2018-10-31 00:15:24 [DEBUG   ] summary = ERROR
2018-10-31 00:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326312  13 58422   924921 A  ERRORERROR'
2018-10-31 00:15:25 [DEBUG   ] Got command RPT from MCS: ref #326313
2018-10-31 00:15:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326313  77 58422   925125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:15:25 [DEBUG   ] Got command RPT from MCS: ref #326314
2018-10-31 00:15:25 [DEBUG   ] summary = ERROR
2018-10-31 00:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326314  13 58422   925317 A  ERRORERROR'
2018-10-31 00:15:25 [DEBUG   ] Got command RPT from MCS: ref #326316
2018-10-31 00:15:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326316  77 58422   925521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:15:25 [DEBUG   ] Got command RPT from MCS: ref #326317
2018-10-31 00:15:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326317  12 58422   925725 A  ERRORB¤ff'
2018-10-31 00:15:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:15:39 [DEBUG   ] Got command RPT from MCS: ref #326322
2018-10-31 00:15:39 [DEBUG   ] summary = ERROR
2018-10-31 00:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326322  13 58422   939997 A  ERRORERROR'
2018-10-31 00:15:39 [DEBUG   ] Got command RPT from MCS: ref #326323
2018-10-31 00:15:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326323  77 58422   939998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:15:42 [DEBUG   ] Got command BAM from MCS: ref #326339
2018-10-31 00:15:42 [INFO    ] Finished processing BAM request
2018-10-31 00:15:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:15:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326339   8 58422   942029 A  ERROR'
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:15:42 [DEBUG   ] spawn_process: at 2018-10-31 00:15:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:15:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 00:16:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:16:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:16:02 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-31 00:16:15 [DEBUG   ] Got command BAM from MCS: ref #326344
2018-10-31 00:16:15 [INFO    ] Finished processing BAM request
2018-10-31 00:16:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326344   8 58422   975033 A  ERROR'
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:16:15 [DEBUG   ] spawn_process: at 2018-10-31 00:16:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:16:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:16:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:16:50 [DEBUG   ] Got command BAM from MCS: ref #326345
2018-10-31 00:16:50 [INFO    ] Finished processing BAM request
2018-10-31 00:16:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326345   8 58422  1010025 A  ERROR'
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:16:50 [DEBUG   ] spawn_process: at 2018-10-31 00:16:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:16:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 00:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:17:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:17:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:17:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:17:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:17:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:17:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:17:02 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-10-31 00:17:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:17:26 [DEBUG   ] Got command BAM from MCS: ref #326346
2018-10-31 00:17:26 [INFO    ] Finished processing BAM request
2018-10-31 00:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326346   8 58422  1046025 A  ERROR'
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:17:26 [DEBUG   ] spawn_process: at 2018-10-31 00:17:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:17:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:17:58 [DEBUG   ] Got command BAM from MCS: ref #326347
2018-10-31 00:17:58 [INFO    ] Finished processing BAM request
2018-10-31 00:17:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326347   8 58422  1078029 A  ERROR'
2018-10-31 00:17:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:17:58 [DEBUG   ] spawn_process: at 2018-10-31 00:17:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2018-10-31 00:18:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:18:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:18:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:18:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:18:02 [WARNING ] (13, 1, 'bot')
2018-10-31 00:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:18:02 [DEBUG   ] Finished updating board flags in 0.971 seconds
2018-10-31 00:18:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 00:18:37 [DEBUG   ] Got command BAM from MCS: ref #326348
2018-10-31 00:18:37 [INFO    ] Finished processing BAM request
2018-10-31 00:18:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326348   8 58422  1117025 A  ERROR'
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:18:37 [DEBUG   ] spawn_process: at 2018-10-31 00:18:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:18:38 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-10-31 00:18:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-31 00:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 00:19:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:19:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:19:03 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-31 00:19:06 [DEBUG   ] Got command BAM from MCS: ref #326353
2018-10-31 00:19:06 [INFO    ] Finished processing BAM request
2018-10-31 00:19:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326353   8 58422  1146029 A  ERROR'
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:19:06 [DEBUG   ] spawn_process: at 2018-10-31 00:19:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:19:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:19:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:19:48 [DEBUG   ] Got command BAM from MCS: ref #326354
2018-10-31 00:19:48 [INFO    ] Finished processing BAM request
2018-10-31 00:19:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326354   8 58422  1188033 A  ERROR'
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:19:48 [DEBUG   ] spawn_process: at 2018-10-31 00:19:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:19:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 00:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:20:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:20:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:20:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:20:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:20:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:20:03 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-10-31 00:20:14 [DEBUG   ] Got command BAM from MCS: ref #326355
2018-10-31 00:20:14 [INFO    ] Finished processing BAM request
2018-10-31 00:20:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326355   8 58422  1214025 A  ERROR'
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:20:14 [DEBUG   ] spawn_process: at 2018-10-31 00:20:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:20:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:20:25 [DEBUG   ] Got command RPT from MCS: ref #326356
2018-10-31 00:20:25 [DEBUG   ] summary = ERROR
2018-10-31 00:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326356  13 58422  1225005 A  ERRORERROR'
2018-10-31 00:20:25 [DEBUG   ] Got command RPT from MCS: ref #326357
2018-10-31 00:20:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326357  77 58422  1225209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:20:25 [DEBUG   ] Got command RPT from MCS: ref #326358
2018-10-31 00:20:25 [DEBUG   ] summary = ERROR
2018-10-31 00:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326358  13 58422  1225401 A  ERRORERROR'
2018-10-31 00:20:25 [DEBUG   ] Got command RPT from MCS: ref #326359
2018-10-31 00:20:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326359  77 58422  1225605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:20:25 [DEBUG   ] Got command RPT from MCS: ref #326360
2018-10-31 00:20:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326360  12 58422  1225809 A  ERRORB¤ff'
2018-10-31 00:20:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:20:39 [DEBUG   ] Got command RPT from MCS: ref #326361
2018-10-31 00:20:39 [DEBUG   ] summary = ERROR
2018-10-31 00:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326361  13 58422  1239997 A  ERRORERROR'
2018-10-31 00:20:39 [DEBUG   ] Got command RPT from MCS: ref #326362
2018-10-31 00:20:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326362  77 58422  1239998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:20:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:20:59 [DEBUG   ] Got command BAM from MCS: ref #326378
2018-10-31 00:20:59 [INFO    ] Finished processing BAM request
2018-10-31 00:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326378   8 58422  1259033 A  ERROR'
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:20:59 [DEBUG   ] spawn_process: at 2018-10-31 00:20:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:21:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:21:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:21:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:21:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:21:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:21:03 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-31 00:21:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 00:21:22 [DEBUG   ] Got command BAM from MCS: ref #326379
2018-10-31 00:21:22 [INFO    ] Finished processing BAM request
2018-10-31 00:21:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326379   8 58422  1282025 A  ERROR'
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:21:22 [DEBUG   ] spawn_process: at 2018-10-31 00:21:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:21:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:21:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:22:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:22:03 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-10-31 00:22:10 [DEBUG   ] Got command BAM from MCS: ref #326384
2018-10-31 00:22:10 [INFO    ] Finished processing BAM request
2018-10-31 00:22:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326384   8 58422  1330029 A  ERROR'
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:22:10 [DEBUG   ] spawn_process: at 2018-10-31 00:22:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:22:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:22:30 [DEBUG   ] Got command BAM from MCS: ref #326385
2018-10-31 00:22:30 [INFO    ] Finished processing BAM request
2018-10-31 00:22:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326385   8 58422  1350033 A  ERROR'
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:22:30 [DEBUG   ] spawn_process: at 2018-10-31 00:22:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:22:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:22:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-31 00:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:23:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:23:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:23:04 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-31 00:23:14 [DEBUG   ] Got command BAM from MCS: ref #326387
2018-10-31 00:23:14 [INFO    ] Finished processing BAM request
2018-10-31 00:23:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326387   8 58422  1394033 A  ERROR'
2018-10-31 00:23:14 [DEBUG   ] Got command BAM from MCS: ref #326386
2018-10-31 00:23:14 [INFO    ] Finished processing BAM request
2018-10-31 00:23:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326386   8 58422  1394037 A  ERROR'
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:23:14 [DEBUG   ] spawn_process: at 2018-10-31 00:23:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:23:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:23:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:23:45 [DEBUG   ] Got command BAM from MCS: ref #326390
2018-10-31 00:23:45 [INFO    ] Finished processing BAM request
2018-10-31 00:23:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326390   8 58422  1425029 A  ERROR'
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:23:45 [DEBUG   ] spawn_process: at 2018-10-31 00:23:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:23:47 [DEBUG   ] Got command BAM from MCS: ref #326391
2018-10-31 00:23:47 [INFO    ] Finished processing BAM request
2018-10-31 00:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326391   8 58422  1427033 A  ERROR'
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:23:47 [DEBUG   ] spawn_process: at 2018-10-31 00:23:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:23:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:24:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:24:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:24:03 [DEBUG   ] Finished updating board flags in 1.268 seconds
2018-10-31 00:24:15 [DEBUG   ] Got command BAM from MCS: ref #326392
2018-10-31 00:24:15 [INFO    ] Finished processing BAM request
2018-10-31 00:24:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326392   8 58422  1455029 A  ERROR'
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:24:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:24:15 [DEBUG   ] spawn_process: at 2018-10-31 00:24:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:24:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:24:20 [DEBUG   ] Got command BAM from MCS: ref #326393
2018-10-31 00:24:20 [INFO    ] Finished processing BAM request
2018-10-31 00:24:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326393   8 58422  1460029 A  ERROR'
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:24:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:24:20 [DEBUG   ] spawn_process: at 2018-10-31 00:24:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:24:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:24:45 [DEBUG   ] Got command BAM from MCS: ref #326394
2018-10-31 00:24:45 [INFO    ] Finished processing BAM request
2018-10-31 00:24:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326394   8 58422  1485025 A  ERROR'
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:24:45 [DEBUG   ] spawn_process: at 2018-10-31 00:24:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:24:53 [DEBUG   ] Got command BAM from MCS: ref #326399
2018-10-31 00:24:53 [INFO    ] Finished processing BAM request
2018-10-31 00:24:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326399   8 58422  1493033 A  ERROR'
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:24:53 [DEBUG   ] spawn_process: at 2018-10-31 00:24:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:24:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 00:25:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:25:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:25:03 [DEBUG   ] Finished updating board flags in 1.231 seconds
2018-10-31 00:25:14 [DEBUG   ] Got command BAM from MCS: ref #326403
2018-10-31 00:25:14 [INFO    ] Finished processing BAM request
2018-10-31 00:25:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326403   8 58422  1514033 A  ERROR'
2018-10-31 00:25:14 [DEBUG   ] Got command BAM from MCS: ref #326402
2018-10-31 00:25:14 [INFO    ] Finished processing BAM request
2018-10-31 00:25:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326402   8 58422  1514037 A  ERROR'
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:25:14 [DEBUG   ] spawn_process: at 2018-10-31 00:25:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:25:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:25:25 [DEBUG   ] Got command RPT from MCS: ref #326406
2018-10-31 00:25:25 [DEBUG   ] summary = ERROR
2018-10-31 00:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326406  13 58422  1525085 A  ERRORERROR'
2018-10-31 00:25:25 [DEBUG   ] Got command RPT from MCS: ref #326407
2018-10-31 00:25:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326407  77 58422  1525289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:25:25 [DEBUG   ] Got command RPT from MCS: ref #326408
2018-10-31 00:25:25 [DEBUG   ] summary = ERROR
2018-10-31 00:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326408  13 58422  1525493 A  ERRORERROR'
2018-10-31 00:25:25 [DEBUG   ] Got command RPT from MCS: ref #326410
2018-10-31 00:25:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326410  77 58422  1525697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:25:25 [DEBUG   ] Got command RPT from MCS: ref #326411
2018-10-31 00:25:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326411  12 58422  1525889 A  ERRORBŁff'
2018-10-31 00:25:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:25:39 [DEBUG   ] Got command RPT from MCS: ref #326416
2018-10-31 00:25:39 [DEBUG   ] summary = ERROR
2018-10-31 00:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326416  13 58422  1539993 A  ERRORERROR'
2018-10-31 00:25:39 [DEBUG   ] Got command RPT from MCS: ref #326417
2018-10-31 00:25:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326417  77 58422  1539994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:25:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 00:26:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:26:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:26:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:26:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:26:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:26:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:26:03 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-31 00:26:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 00:26:22 [DEBUG   ] Got command BAM from MCS: ref #326433
2018-10-31 00:26:22 [INFO    ] Finished processing BAM request
2018-10-31 00:26:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326433   8 58422  1582029 A  ERROR'
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:26:22 [DEBUG   ] spawn_process: at 2018-10-31 00:26:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:26:25 [DEBUG   ] Got command BAM from MCS: ref #326434
2018-10-31 00:26:25 [INFO    ] Finished processing BAM request
2018-10-31 00:26:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:26:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326434   8 58422  1585025 A  ERROR'
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:26:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:26:25 [DEBUG   ] spawn_process: at 2018-10-31 00:26:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:26:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:26:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 00:27:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:27:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:27:03 [DEBUG   ] Finished updating board flags in 1.117 seconds
2018-10-31 00:27:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:27:30 [DEBUG   ] Got command BAM from MCS: ref #326435
2018-10-31 00:27:30 [INFO    ] Finished processing BAM request
2018-10-31 00:27:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326435   8 58422  1650029 A  ERROR'
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:27:30 [DEBUG   ] spawn_process: at 2018-10-31 00:27:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:27:36 [DEBUG   ] Got command BAM from MCS: ref #326436
2018-10-31 00:27:36 [INFO    ] Finished processing BAM request
2018-10-31 00:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326436   8 58422  1656029 A  ERROR'
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:27:36 [DEBUG   ] spawn_process: at 2018-10-31 00:27:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:27:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:27:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:28:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:28:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:28:03 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-10-31 00:28:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:28:38 [DEBUG   ] Got command BAM from MCS: ref #326441
2018-10-31 00:28:38 [INFO    ] Finished processing BAM request
2018-10-31 00:28:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326441   8 58422  1718029 A  ERROR'
2018-10-31 00:28:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:28:38 [DEBUG   ] spawn_process: at 2018-10-31 00:28:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:28:47 [DEBUG   ] Got command BAM from MCS: ref #326442
2018-10-31 00:28:47 [INFO    ] Finished processing BAM request
2018-10-31 00:28:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326442   8 58422  1727025 A  ERROR'
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:28:47 [DEBUG   ] spawn_process: at 2018-10-31 00:28:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:28:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2018-10-31 00:29:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:29:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 00:29:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:29:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:29:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:29:03 [WARNING ] (13, 1, 'bot')
2018-10-31 00:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:29:03 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-10-31 00:29:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:29:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:29:46 [DEBUG   ] Got command BAM from MCS: ref #326443
2018-10-31 00:29:46 [INFO    ] Finished processing BAM request
2018-10-31 00:29:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326443   8 58422  1786029 A  ERROR'
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:29:46 [DEBUG   ] spawn_process: at 2018-10-31 00:29:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:29:58 [DEBUG   ] Got command BAM from MCS: ref #326444
2018-10-31 00:29:58 [INFO    ] Finished processing BAM request
2018-10-31 00:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326444   8 58422  1798033 A  ERROR'
2018-10-31 00:29:58 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:29:58 [DEBUG   ] spawn_process: at 2018-10-31 00:29:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-31 00:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 00:30:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:30:04 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-10-31 00:30:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:30:25 [DEBUG   ] Got command RPT from MCS: ref #326445
2018-10-31 00:30:25 [DEBUG   ] summary = ERROR
2018-10-31 00:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326445  13 58422  1825173 A  ERRORERROR'
2018-10-31 00:30:25 [DEBUG   ] Got command RPT from MCS: ref #326446
2018-10-31 00:30:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326446  77 58422  1825377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:30:25 [DEBUG   ] Got command RPT from MCS: ref #326447
2018-10-31 00:30:25 [DEBUG   ] summary = ERROR
2018-10-31 00:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326447  13 58422  1825581 A  ERRORERROR'
2018-10-31 00:30:25 [DEBUG   ] Got command RPT from MCS: ref #326448
2018-10-31 00:30:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326448  77 58422  1825785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:30:25 [DEBUG   ] Got command RPT from MCS: ref #326449
2018-10-31 00:30:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326449  12 58422  1825977 A  ERRORB˘ff'
2018-10-31 00:30:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:30:39 [DEBUG   ] Got command RPT from MCS: ref #326450
2018-10-31 00:30:39 [DEBUG   ] summary = ERROR
2018-10-31 00:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326450  13 58422  1839989 A  ERRORERROR'
2018-10-31 00:30:39 [DEBUG   ] Got command RPT from MCS: ref #326451
2018-10-31 00:30:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326451  77 58422  1839990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:30:54 [DEBUG   ] Got command BAM from MCS: ref #326471
2018-10-31 00:30:54 [INFO    ] Finished processing BAM request
2018-10-31 00:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326471   8 58422  1854037 A  ERROR'
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:30:54 [DEBUG   ] spawn_process: at 2018-10-31 00:30:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:30:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:31:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:31:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:31:04 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-10-31 00:31:09 [DEBUG   ] Got command BAM from MCS: ref #326472
2018-10-31 00:31:09 [INFO    ] Finished processing BAM request
2018-10-31 00:31:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326472   8 58422  1869025 A  ERROR'
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:31:09 [DEBUG   ] spawn_process: at 2018-10-31 00:31:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:31:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:31:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:31:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:32:02 [DEBUG   ] Got command BAM from MCS: ref #326473
2018-10-31 00:32:02 [INFO    ] Finished processing BAM request
2018-10-31 00:32:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326473   8 58422  1922033 A  ERROR'
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:32:02 [DEBUG   ] spawn_process: at 2018-10-31 00:32:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:32:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 00:32:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:32:04 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-10-31 00:32:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:32:20 [DEBUG   ] Got command BAM from MCS: ref #326474
2018-10-31 00:32:20 [INFO    ] Finished processing BAM request
2018-10-31 00:32:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326474   8 58422  1940025 A  ERROR'
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:32:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:32:20 [DEBUG   ] spawn_process: at 2018-10-31 00:32:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:32:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:32:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:33:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:33:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:33:04 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-10-31 00:33:10 [DEBUG   ] Got command BAM from MCS: ref #326475
2018-10-31 00:33:10 [INFO    ] Finished processing BAM request
2018-10-31 00:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326475   8 58422  1990029 A  ERROR'
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:33:10 [DEBUG   ] spawn_process: at 2018-10-31 00:33:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:33:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:33:31 [DEBUG   ] Got command BAM from MCS: ref #326476
2018-10-31 00:33:31 [INFO    ] Finished processing BAM request
2018-10-31 00:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326476   8 58422  2011029 A  ERROR'
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:33:31 [DEBUG   ] spawn_process: at 2018-10-31 00:33:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:33:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:33:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:34:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:34:05 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-31 00:34:18 [DEBUG   ] Got command BAM from MCS: ref #326481
2018-10-31 00:34:18 [INFO    ] Finished processing BAM request
2018-10-31 00:34:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326481   8 58422  2058033 A  ERROR'
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:34:18 [DEBUG   ] spawn_process: at 2018-10-31 00:34:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:34:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:34:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:34:42 [DEBUG   ] Got command BAM from MCS: ref #326482
2018-10-31 00:34:42 [INFO    ] Finished processing BAM request
2018-10-31 00:34:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326482   8 58422  2082025 A  ERROR'
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:34:42 [DEBUG   ] spawn_process: at 2018-10-31 00:34:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:34:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:35:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:35:05 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-31 00:35:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:35:25 [DEBUG   ] Got command RPT from MCS: ref #326486
2018-10-31 00:35:25 [DEBUG   ] summary = ERROR
2018-10-31 00:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326486  13 58422  2125269 A  ERRORERROR'
2018-10-31 00:35:25 [DEBUG   ] Got command RPT from MCS: ref #326487
2018-10-31 00:35:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326487  77 58422  2125461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:35:25 [DEBUG   ] Got command RPT from MCS: ref #326488
2018-10-31 00:35:25 [DEBUG   ] summary = ERROR
2018-10-31 00:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326488  13 58422  2125665 A  ERRORERROR'
2018-10-31 00:35:25 [DEBUG   ] Got command RPT from MCS: ref #326490
2018-10-31 00:35:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326490  77 58422  2125869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:35:26 [DEBUG   ] Got command BAM from MCS: ref #326485
2018-10-31 00:35:26 [INFO    ] Finished processing BAM request
2018-10-31 00:35:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326485   8 58422  2126029 A  ERROR'
2018-10-31 00:35:26 [DEBUG   ] Got command RPT from MCS: ref #326491
2018-10-31 00:35:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326491  12 58422  2126065 A  ERRORB¤ff'
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:35:26 [DEBUG   ] spawn_process: at 2018-10-31 00:35:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:35:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:35:40 [DEBUG   ] Got command RPT from MCS: ref #326496
2018-10-31 00:35:40 [DEBUG   ] summary = ERROR
2018-10-31 00:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326496  13 58422  2140001 A  ERRORERROR'
2018-10-31 00:35:40 [DEBUG   ] Got command RPT from MCS: ref #326497
2018-10-31 00:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326497  77 58422  2140002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:35:53 [DEBUG   ] Got command BAM from MCS: ref #326513
2018-10-31 00:35:53 [INFO    ] Finished processing BAM request
2018-10-31 00:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326513   8 58422  2153025 A  ERROR'
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:35:53 [DEBUG   ] spawn_process: at 2018-10-31 00:35:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:35:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:36:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:36:04 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-31 00:36:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:36:34 [DEBUG   ] Got command BAM from MCS: ref #326514
2018-10-31 00:36:34 [INFO    ] Finished processing BAM request
2018-10-31 00:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326514   8 58422  2194025 A  ERROR'
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:36:34 [DEBUG   ] spawn_process: at 2018-10-31 00:36:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:36:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:36:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:37:04 [DEBUG   ] Got command BAM from MCS: ref #326519
2018-10-31 00:37:04 [INFO    ] Finished processing BAM request
2018-10-31 00:37:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:37:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326519   8 58422  2224025 A  ERROR'
2018-10-31 00:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:37:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:37:04 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:37:04 [DEBUG   ] spawn_process: at 2018-10-31 00:37:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:37:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:37:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:37:42 [DEBUG   ] Got command BAM from MCS: ref #326520
2018-10-31 00:37:42 [INFO    ] Finished processing BAM request
2018-10-31 00:37:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326520   8 58422  2262029 A  ERROR'
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:37:42 [DEBUG   ] spawn_process: at 2018-10-31 00:37:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:37:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-31 00:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:38:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:38:04 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-31 00:38:15 [DEBUG   ] Got command BAM from MCS: ref #326521
2018-10-31 00:38:15 [INFO    ] Finished processing BAM request
2018-10-31 00:38:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326521   8 58422  2295025 A  ERROR'
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:38:15 [DEBUG   ] spawn_process: at 2018-10-31 00:38:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:38:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:38:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:38:50 [DEBUG   ] Got command BAM from MCS: ref #326522
2018-10-31 00:38:50 [INFO    ] Finished processing BAM request
2018-10-31 00:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326522   8 58422  2330025 A  ERROR'
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:38:50 [DEBUG   ] spawn_process: at 2018-10-31 00:38:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:38:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:39:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:39:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:39:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:39:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:39:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:39:04 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-10-31 00:39:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:39:26 [DEBUG   ] Got command BAM from MCS: ref #326523
2018-10-31 00:39:26 [INFO    ] Finished processing BAM request
2018-10-31 00:39:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326523   8 58422  2366025 A  ERROR'
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:39:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:39:26 [DEBUG   ] spawn_process: at 2018-10-31 00:39:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:39:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 00:39:58 [DEBUG   ] Got command BAM from MCS: ref #326528
2018-10-31 00:39:58 [INFO    ] Finished processing BAM request
2018-10-31 00:39:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326528   8 58422  2398025 A  ERROR'
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:39:58 [DEBUG   ] spawn_process: at 2018-10-31 00:39:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:39:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:40:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:40:04 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-10-31 00:40:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:40:25 [DEBUG   ] Got command RPT from MCS: ref #326529
2018-10-31 00:40:25 [DEBUG   ] summary = ERROR
2018-10-31 00:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326529  13 58422  2425353 A  ERRORERROR'
2018-10-31 00:40:25 [DEBUG   ] Got command RPT from MCS: ref #326530
2018-10-31 00:40:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326530  77 58422  2425545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:40:25 [DEBUG   ] Got command RPT from MCS: ref #326531
2018-10-31 00:40:25 [DEBUG   ] summary = ERROR
2018-10-31 00:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326531  13 58422  2425749 A  ERRORERROR'
2018-10-31 00:40:25 [DEBUG   ] Got command RPT from MCS: ref #326532
2018-10-31 00:40:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326532  77 58422  2425953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:40:26 [DEBUG   ] Got command RPT from MCS: ref #326533
2018-10-31 00:40:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326533  12 58422  2426157 A  ERRORBŁff'
2018-10-31 00:40:37 [DEBUG   ] Got command BAM from MCS: ref #326534
2018-10-31 00:40:37 [INFO    ] Finished processing BAM request
2018-10-31 00:40:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326534   8 58422  2437029 A  ERROR'
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:40:37 [DEBUG   ] spawn_process: at 2018-10-31 00:40:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:40:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:40:39 [DEBUG   ] Got command RPT from MCS: ref #326535
2018-10-31 00:40:39 [DEBUG   ] summary = ERROR
2018-10-31 00:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326535  13 58422  2439993 A  ERRORERROR'
2018-10-31 00:40:39 [DEBUG   ] Got command RPT from MCS: ref #326536
2018-10-31 00:40:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326536  77 58422  2439994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:40:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 00:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 00:41:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:41:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:41:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:41:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:41:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:41:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:41:05 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-31 00:41:06 [DEBUG   ] Got command BAM from MCS: ref #326552
2018-10-31 00:41:06 [INFO    ] Finished processing BAM request
2018-10-31 00:41:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326552   8 58422  2466025 A  ERROR'
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:41:06 [DEBUG   ] spawn_process: at 2018-10-31 00:41:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:41:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 00:41:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:41:48 [DEBUG   ] Got command BAM from MCS: ref #326553
2018-10-31 00:41:48 [INFO    ] Finished processing BAM request
2018-10-31 00:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326553   8 58422  2508033 A  ERROR'
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:41:48 [DEBUG   ] spawn_process: at 2018-10-31 00:41:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:41:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:42:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:42:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:42:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:42:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:42:04 [WARNING ] (13, 1, 'bot')
2018-10-31 00:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:42:04 [DEBUG   ] Finished updating board flags in 0.965 seconds
2018-10-31 00:42:14 [DEBUG   ] Got command BAM from MCS: ref #326554
2018-10-31 00:42:14 [INFO    ] Finished processing BAM request
2018-10-31 00:42:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326554   8 58422  2534033 A  ERROR'
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:42:14 [DEBUG   ] spawn_process: at 2018-10-31 00:42:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:42:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:42:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:42:59 [DEBUG   ] Got command BAM from MCS: ref #326559
2018-10-31 00:42:59 [INFO    ] Finished processing BAM request
2018-10-31 00:42:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:42:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326559   8 58422  2579029 A  ERROR'
2018-10-31 00:42:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:42:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:42:59 [DEBUG   ] spawn_process: at 2018-10-31 00:42:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:43:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:43:05 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-31 00:43:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:43:22 [DEBUG   ] Got command BAM from MCS: ref #326560
2018-10-31 00:43:22 [INFO    ] Finished processing BAM request
2018-10-31 00:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326560   8 58422  2602033 A  ERROR'
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:43:22 [DEBUG   ] spawn_process: at 2018-10-31 00:43:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:43:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 00:43:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 00:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-31 00:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:44:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:44:05 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-31 00:44:10 [DEBUG   ] Got command BAM from MCS: ref #326561
2018-10-31 00:44:10 [INFO    ] Finished processing BAM request
2018-10-31 00:44:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326561   8 58422  2650033 A  ERROR'
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:44:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:44:10 [DEBUG   ] spawn_process: at 2018-10-31 00:44:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:44:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 00:44:30 [DEBUG   ] Got command BAM from MCS: ref #326562
2018-10-31 00:44:30 [INFO    ] Finished processing BAM request
2018-10-31 00:44:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326562   8 58422  2670025 A  ERROR'
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:44:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:44:30 [DEBUG   ] spawn_process: at 2018-10-31 00:44:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:44:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:44:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 00:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:45:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:45:05 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-31 00:45:14 [DEBUG   ] Got command BAM from MCS: ref #326566
2018-10-31 00:45:14 [INFO    ] Finished processing BAM request
2018-10-31 00:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326566   8 58422  2714025 A  ERROR'
2018-10-31 00:45:14 [DEBUG   ] Got command BAM from MCS: ref #326565
2018-10-31 00:45:14 [INFO    ] Finished processing BAM request
2018-10-31 00:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326565   8 58422  2714029 A  ERROR'
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:45:14 [DEBUG   ] spawn_process: at 2018-10-31 00:45:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:45:19 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-31 00:45:25 [DEBUG   ] Got command RPT from MCS: ref #326569
2018-10-31 00:45:25 [DEBUG   ] summary = ERROR
2018-10-31 00:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326569  13 58422  2725433 A  ERRORERROR'
2018-10-31 00:45:25 [DEBUG   ] Got command RPT from MCS: ref #326570
2018-10-31 00:45:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326570  77 58422  2725637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:45:25 [DEBUG   ] Got command RPT from MCS: ref #326571
2018-10-31 00:45:25 [DEBUG   ] summary = ERROR
2018-10-31 00:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326571  13 58422  2725841 A  ERRORERROR'
2018-10-31 00:45:26 [DEBUG   ] Got command RPT from MCS: ref #326573
2018-10-31 00:45:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326573  77 58422  2726033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:45:26 [DEBUG   ] Got command RPT from MCS: ref #326574
2018-10-31 00:45:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326574  12 58422  2726237 A  ERRORBŁff'
2018-10-31 00:45:39 [DEBUG   ] Got command BAM from MCS: ref #326579
2018-10-31 00:45:39 [INFO    ] Finished processing BAM request
2018-10-31 00:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326579   8 58422  2739025 A  ERROR'
2018-10-31 00:45:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:45:39 [DEBUG   ] spawn_process: at 2018-10-31 00:45:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:45:39 [DEBUG   ] Got command RPT from MCS: ref #326580
2018-10-31 00:45:39 [DEBUG   ] summary = ERROR
2018-10-31 00:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326580  13 58422  2739997 A  ERRORERROR'
2018-10-31 00:45:39 [DEBUG   ] Got command RPT from MCS: ref #326581
2018-10-31 00:45:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326581  77 58422  2739998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:45:43 [DEBUG   ] Got command BAM from MCS: ref #326597
2018-10-31 00:45:43 [INFO    ] Finished processing BAM request
2018-10-31 00:45:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:45:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326597   8 58422  2743025 A  ERROR'
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:45:43 [DEBUG   ] spawn_process: at 2018-10-31 00:45:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:45:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:46:04 [DEBUG   ] Got command BAM from MCS: ref #326602
2018-10-31 00:46:04 [INFO    ] Finished processing BAM request
2018-10-31 00:46:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326602   8 58422  2764033 A  ERROR'
2018-10-31 00:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 00:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:46:04 [DEBUG   ] spawn_process: at 2018-10-31 00:46:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:46:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:46:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:46:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:46:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:46:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:46:05 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-10-31 00:46:12 [DEBUG   ] Got command BAM from MCS: ref #326603
2018-10-31 00:46:12 [INFO    ] Finished processing BAM request
2018-10-31 00:46:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326603   8 58422  2772033 A  ERROR'
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:46:12 [DEBUG   ] spawn_process: at 2018-10-31 00:46:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:46:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:46:29 [DEBUG   ] Got command BAM from MCS: ref #326604
2018-10-31 00:46:29 [INFO    ] Finished processing BAM request
2018-10-31 00:46:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:46:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326604   8 58422  2789025 A  ERROR'
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:46:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:46:29 [DEBUG   ] spawn_process: at 2018-10-31 00:46:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:46:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:46:41 [DEBUG   ] Got command BAM from MCS: ref #326605
2018-10-31 00:46:41 [INFO    ] Finished processing BAM request
2018-10-31 00:46:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326605   8 58422  2801025 A  ERROR'
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:46:41 [DEBUG   ] spawn_process: at 2018-10-31 00:46:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:46:54 [DEBUG   ] Got command BAM from MCS: ref #326606
2018-10-31 00:46:54 [INFO    ] Finished processing BAM request
2018-10-31 00:46:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326606   8 58422  2814025 A  ERROR'
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:46:54 [DEBUG   ] spawn_process: at 2018-10-31 00:46:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:46:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 00:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:47:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:47:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:47:05 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-10-31 00:47:10 [DEBUG   ] Got command BAM from MCS: ref #326607
2018-10-31 00:47:10 [INFO    ] Finished processing BAM request
2018-10-31 00:47:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326607   8 58422  2830025 A  ERROR'
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:47:10 [DEBUG   ] spawn_process: at 2018-10-31 00:47:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:47:14 [DEBUG   ] Got command BAM from MCS: ref #326608
2018-10-31 00:47:14 [INFO    ] Finished processing BAM request
2018-10-31 00:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326608   8 58422  2834025 A  ERROR'
2018-10-31 00:47:14 [DEBUG   ] Got command BAM from MCS: ref #326609
2018-10-31 00:47:14 [INFO    ] Finished processing BAM request
2018-10-31 00:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326609   8 58422  2834029 A  ERROR'
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:47:14 [DEBUG   ] spawn_process: at 2018-10-31 00:47:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:47:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:47:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:47:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 00:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-31 00:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-31 00:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:48:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:48:05 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-10-31 00:48:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:48:22 [DEBUG   ] Got command BAM from MCS: ref #326612
2018-10-31 00:48:22 [INFO    ] Finished processing BAM request
2018-10-31 00:48:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326612   8 58422  2902033 A  ERROR'
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:48:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:48:22 [DEBUG   ] spawn_process: at 2018-10-31 00:48:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:48:25 [DEBUG   ] Got command BAM from MCS: ref #326613
2018-10-31 00:48:25 [INFO    ] Finished processing BAM request
2018-10-31 00:48:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326613   8 58422  2905029 A  ERROR'
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:48:25 [DEBUG   ] spawn_process: at 2018-10-31 00:48:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:48:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:48:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 00:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:49:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:49:06 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-10-31 00:49:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 00:49:30 [DEBUG   ] Got command BAM from MCS: ref #326618
2018-10-31 00:49:30 [INFO    ] Finished processing BAM request
2018-10-31 00:49:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326618   8 58422  2970029 A  ERROR'
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:49:30 [DEBUG   ] spawn_process: at 2018-10-31 00:49:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:49:36 [DEBUG   ] Got command BAM from MCS: ref #326619
2018-10-31 00:49:36 [INFO    ] Finished processing BAM request
2018-10-31 00:49:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326619   8 58422  2976033 A  ERROR'
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:49:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:49:36 [DEBUG   ] spawn_process: at 2018-10-31 00:49:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:49:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:49:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 00:50:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-31 00:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:50:05 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-10-31 00:50:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:50:25 [DEBUG   ] Got command RPT from MCS: ref #326620
2018-10-31 00:50:25 [DEBUG   ] summary = ERROR
2018-10-31 00:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326620  13 58422  3025521 A  ERRORERROR'
2018-10-31 00:50:25 [DEBUG   ] Got command RPT from MCS: ref #326621
2018-10-31 00:50:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326621  77 58422  3025713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:50:25 [DEBUG   ] Got command RPT from MCS: ref #326622
2018-10-31 00:50:25 [DEBUG   ] summary = ERROR
2018-10-31 00:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326622  13 58422  3025917 A  ERRORERROR'
2018-10-31 00:50:26 [DEBUG   ] Got command RPT from MCS: ref #326623
2018-10-31 00:50:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326623  77 58422  3026121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:50:26 [DEBUG   ] Got command RPT from MCS: ref #326624
2018-10-31 00:50:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326624  12 58422  3026325 A  ERRORBŁff'
2018-10-31 00:50:38 [DEBUG   ] Got command BAM from MCS: ref #326625
2018-10-31 00:50:38 [INFO    ] Finished processing BAM request
2018-10-31 00:50:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:50:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326625   8 58422  3038029 A  ERROR'
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:50:38 [DEBUG   ] spawn_process: at 2018-10-31 00:50:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:50:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:50:39 [DEBUG   ] Got command RPT from MCS: ref #326626
2018-10-31 00:50:39 [DEBUG   ] summary = ERROR
2018-10-31 00:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326626  13 58422  3039997 A  ERRORERROR'
2018-10-31 00:50:39 [DEBUG   ] Got command RPT from MCS: ref #326627
2018-10-31 00:50:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326627  77 58422  3039998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:50:47 [DEBUG   ] Got command BAM from MCS: ref #326643
2018-10-31 00:50:47 [INFO    ] Finished processing BAM request
2018-10-31 00:50:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:50:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326643   8 58422  3047033 A  ERROR'
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:50:47 [DEBUG   ] spawn_process: at 2018-10-31 00:50:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:50:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:51:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:51:06 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-31 00:51:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:51:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:51:46 [DEBUG   ] Got command BAM from MCS: ref #326644
2018-10-31 00:51:46 [INFO    ] Finished processing BAM request
2018-10-31 00:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326644   8 58422  3106025 A  ERROR'
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:51:46 [DEBUG   ] spawn_process: at 2018-10-31 00:51:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:51:58 [DEBUG   ] Got command BAM from MCS: ref #326649
2018-10-31 00:51:58 [INFO    ] Finished processing BAM request
2018-10-31 00:51:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326649   8 58422  3118029 A  ERROR'
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:51:58 [DEBUG   ] spawn_process: at 2018-10-31 00:51:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:51:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 00:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:52:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 00:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:52:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:52:06 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-31 00:52:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:52:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:52:54 [DEBUG   ] Got command BAM from MCS: ref #326650
2018-10-31 00:52:54 [INFO    ] Finished processing BAM request
2018-10-31 00:52:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:52:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326650   8 58422  3174025 A  ERROR'
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:52:54 [DEBUG   ] spawn_process: at 2018-10-31 00:52:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:52:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:53:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:53:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:53:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:53:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:53:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:53:06 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-10-31 00:53:09 [DEBUG   ] Got command BAM from MCS: ref #326651
2018-10-31 00:53:09 [INFO    ] Finished processing BAM request
2018-10-31 00:53:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326651   8 58422  3189029 A  ERROR'
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:53:09 [DEBUG   ] spawn_process: at 2018-10-31 00:53:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:53:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:53:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:53:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:54:02 [DEBUG   ] Got command BAM from MCS: ref #326652
2018-10-31 00:54:02 [INFO    ] Finished processing BAM request
2018-10-31 00:54:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326652   8 58422  3242029 A  ERROR'
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:54:02 [DEBUG   ] spawn_process: at 2018-10-31 00:54:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-31 00:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 00:54:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:54:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:54:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:54:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:54:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:54:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:54:06 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-10-31 00:54:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:54:21 [DEBUG   ] Got command BAM from MCS: ref #326653
2018-10-31 00:54:21 [INFO    ] Finished processing BAM request
2018-10-31 00:54:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326653   8 58422  3261029 A  ERROR'
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:54:21 [DEBUG   ] spawn_process: at 2018-10-31 00:54:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:54:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:54:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:55:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:55:06 [DEBUG   ] Finished updating board flags in 1.052 seconds
2018-10-31 00:55:10 [DEBUG   ] Got command BAM from MCS: ref #326660
2018-10-31 00:55:10 [INFO    ] Finished processing BAM request
2018-10-31 00:55:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326660   8 58422  3310025 A  ERROR'
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:55:10 [DEBUG   ] spawn_process: at 2018-10-31 00:55:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:55:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:55:25 [DEBUG   ] Got command RPT from MCS: ref #326661
2018-10-31 00:55:25 [DEBUG   ] summary = ERROR
2018-10-31 00:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326661  13 58422  3325601 A  ERRORERROR'
2018-10-31 00:55:25 [DEBUG   ] Got command RPT from MCS: ref #326662
2018-10-31 00:55:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326662  77 58422  3325805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:55:26 [DEBUG   ] Got command RPT from MCS: ref #326663
2018-10-31 00:55:26 [DEBUG   ] summary = ERROR
2018-10-31 00:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326663  13 58422  3326009 A  ERRORERROR'
2018-10-31 00:55:26 [DEBUG   ] Got command RPT from MCS: ref #326665
2018-10-31 00:55:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326665  77 58422  3326201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:55:26 [DEBUG   ] Got command RPT from MCS: ref #326666
2018-10-31 00:55:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 00:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326666  12 58422  3326405 A  ERRORB˘ff'
2018-10-31 00:55:33 [DEBUG   ] Got command BAM from MCS: ref #326671
2018-10-31 00:55:33 [INFO    ] Finished processing BAM request
2018-10-31 00:55:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:55:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326671   8 58422  3333033 A  ERROR'
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:55:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:55:33 [DEBUG   ] spawn_process: at 2018-10-31 00:55:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:55:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:55:40 [DEBUG   ] Got command RPT from MCS: ref #326672
2018-10-31 00:55:40 [DEBUG   ] summary = ERROR
2018-10-31 00:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326672  13 58422  3340001 A  ERRORERROR'
2018-10-31 00:55:40 [DEBUG   ] Got command RPT from MCS: ref #326673
2018-10-31 00:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 00:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326673  77 58422  3340002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 00:55:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:56:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 00:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:56:07 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-31 00:56:18 [DEBUG   ] Got command BAM from MCS: ref #326689
2018-10-31 00:56:18 [INFO    ] Finished processing BAM request
2018-10-31 00:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326689   8 58422  3378029 A  ERROR'
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:56:18 [DEBUG   ] spawn_process: at 2018-10-31 00:56:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:56:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:56:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:56:45 [DEBUG   ] Got command BAM from MCS: ref #326690
2018-10-31 00:56:45 [INFO    ] Finished processing BAM request
2018-10-31 00:56:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326690   8 58422  3405029 A  ERROR'
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:56:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:56:45 [DEBUG   ] spawn_process: at 2018-10-31 00:56:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:56:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-31 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 00:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 00:57:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 00:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:57:07 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-31 00:57:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:57:26 [DEBUG   ] Got command BAM from MCS: ref #326691
2018-10-31 00:57:26 [INFO    ] Finished processing BAM request
2018-10-31 00:57:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326691   8 58422  3446025 A  ERROR'
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 00:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 00:57:26 [DEBUG   ] spawn_process: at 2018-10-31 00:57:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 00:57:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:57:57 [DEBUG   ] Got command BAM from MCS: ref #326696
2018-10-31 00:57:57 [INFO    ] Finished processing BAM request
2018-10-31 00:57:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:57:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326696   8 58422  3477033 A  ERROR'
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 00:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 00:57:57 [DEBUG   ] spawn_process: at 2018-10-31 00:57:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 00:57:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 00:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 00:58:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:58:06 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-10-31 00:58:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:58:34 [DEBUG   ] Got command BAM from MCS: ref #326697
2018-10-31 00:58:34 [INFO    ] Finished processing BAM request
2018-10-31 00:58:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326697   8 58422  3514029 A  ERROR'
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 00:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 00:58:34 [DEBUG   ] spawn_process: at 2018-10-31 00:58:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 00:58:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:58:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 00:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 00:59:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 00:59:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-31 00:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 00:59:06 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-10-31 00:59:09 [DEBUG   ] Got command BAM from MCS: ref #326698
2018-10-31 00:59:09 [INFO    ] Finished processing BAM request
2018-10-31 00:59:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326698   8 58422  3549025 A  ERROR'
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 00:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 00:59:09 [DEBUG   ] spawn_process: at 2018-10-31 00:59:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 00:59:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:59:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 00:59:42 [DEBUG   ] Got command BAM from MCS: ref #326699
2018-10-31 00:59:42 [INFO    ] Finished processing BAM request
2018-10-31 00:59:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 00:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326699   8 58422  3582025 A  ERROR'
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 00:59:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 00:59:42 [DEBUG   ] spawn_process: at 2018-10-31 00:59:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 00:59:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:00:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 01:00:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:00:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:00:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:00:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:00:06 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-10-31 01:00:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:00:21 [DEBUG   ] Got command BAM from MCS: ref #326700
2018-10-31 01:00:21 [INFO    ] Finished processing BAM request
2018-10-31 01:00:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326700   8 58422  3621025 A  ERROR'
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:00:21 [DEBUG   ] spawn_process: at 2018-10-31 01:00:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:00:25 [DEBUG   ] Got command RPT from MCS: ref #326701
2018-10-31 01:00:25 [DEBUG   ] summary = ERROR
2018-10-31 01:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326701  13 58422  3625693 A  ERRORERROR'
2018-10-31 01:00:25 [DEBUG   ] Got command RPT from MCS: ref #326702
2018-10-31 01:00:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326702  77 58422  3625885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:00:26 [DEBUG   ] Got command RPT from MCS: ref #326703
2018-10-31 01:00:26 [DEBUG   ] summary = ERROR
2018-10-31 01:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326703  13 58422  3626089 A  ERRORERROR'
2018-10-31 01:00:26 [DEBUG   ] Got command RPT from MCS: ref #326704
2018-10-31 01:00:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326704  77 58422  3626293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:00:26 [DEBUG   ] Got command RPT from MCS: ref #326705
2018-10-31 01:00:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326705  12 58422  3626485 A  ERRORB˘ff'
2018-10-31 01:00:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:00:40 [DEBUG   ] Got command RPT from MCS: ref #326706
2018-10-31 01:00:40 [DEBUG   ] summary = ERROR
2018-10-31 01:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326706  13 58422  3640001 A  ERRORERROR'
2018-10-31 01:00:40 [DEBUG   ] Got command RPT from MCS: ref #326707
2018-10-31 01:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326707  77 58422  3640002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:00:50 [DEBUG   ] Got command BAM from MCS: ref #326727
2018-10-31 01:00:50 [INFO    ] Finished processing BAM request
2018-10-31 01:00:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326727   8 58422  3650029 A  ERROR'
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:00:50 [DEBUG   ] spawn_process: at 2018-10-31 01:00:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:00:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:01:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-31 01:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:01:06 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-31 01:01:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:01:33 [DEBUG   ] Got command BAM from MCS: ref #326728
2018-10-31 01:01:33 [INFO    ] Finished processing BAM request
2018-10-31 01:01:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326728   8 58422  3693033 A  ERROR'
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:01:33 [DEBUG   ] spawn_process: at 2018-10-31 01:01:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:01:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:01:58 [DEBUG   ] Got command BAM from MCS: ref #326729
2018-10-31 01:01:58 [INFO    ] Finished processing BAM request
2018-10-31 01:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326729   8 58422  3718029 A  ERROR'
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:01:58 [DEBUG   ] spawn_process: at 2018-10-31 01:01:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:01:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 01:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:02:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:02:07 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-31 01:02:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:02:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:02:45 [DEBUG   ] Got command BAM from MCS: ref #326730
2018-10-31 01:02:45 [INFO    ] Finished processing BAM request
2018-10-31 01:02:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:02:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326730   8 58422  3765029 A  ERROR'
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:02:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:02:45 [DEBUG   ] spawn_process: at 2018-10-31 01:02:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:02:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:03:06 [DEBUG   ] Got command BAM from MCS: ref #326731
2018-10-31 01:03:06 [INFO    ] Finished processing BAM request
2018-10-31 01:03:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326731   8 58422  3786025 A  ERROR'
2018-10-31 01:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:03:06 [DEBUG   ] spawn_process: at 2018-10-31 01:03:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:03:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:03:07 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-31 01:03:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:03:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:03:57 [DEBUG   ] Got command BAM from MCS: ref #326736
2018-10-31 01:03:57 [INFO    ] Finished processing BAM request
2018-10-31 01:03:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326736   8 58422  3837029 A  ERROR'
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:03:57 [DEBUG   ] spawn_process: at 2018-10-31 01:03:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:03:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:04:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:04:07 [DEBUG   ] Finished updating board flags in 1.292 seconds
2018-10-31 01:04:14 [DEBUG   ] Got command BAM from MCS: ref #326737
2018-10-31 01:04:14 [INFO    ] Finished processing BAM request
2018-10-31 01:04:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:04:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326737   8 58422  3854029 A  ERROR'
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:04:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:04:14 [DEBUG   ] spawn_process: at 2018-10-31 01:04:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:04:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:04:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:04:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:05:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-31 01:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:05:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:05:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:05:07 [DEBUG   ] Finished updating board flags in 1.113 seconds
2018-10-31 01:05:09 [DEBUG   ] Got command BAM from MCS: ref #326740
2018-10-31 01:05:09 [INFO    ] Finished processing BAM request
2018-10-31 01:05:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326740   8 58422  3909029 A  ERROR'
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:05:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:05:09 [DEBUG   ] spawn_process: at 2018-10-31 01:05:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:05:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:05:23 [DEBUG   ] Got command BAM from MCS: ref #326741
2018-10-31 01:05:23 [INFO    ] Finished processing BAM request
2018-10-31 01:05:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326741   8 58422  3923033 A  ERROR'
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:05:23 [DEBUG   ] spawn_process: at 2018-10-31 01:05:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:05:25 [DEBUG   ] Got command RPT from MCS: ref #326742
2018-10-31 01:05:25 [DEBUG   ] summary = ERROR
2018-10-31 01:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326742  13 58422  3925769 A  ERRORERROR'
2018-10-31 01:05:25 [DEBUG   ] Got command RPT from MCS: ref #326743
2018-10-31 01:05:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326743  77 58422  3925973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:05:26 [DEBUG   ] Got command RPT from MCS: ref #326744
2018-10-31 01:05:26 [DEBUG   ] summary = ERROR
2018-10-31 01:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326744  13 58422  3926177 A  ERRORERROR'
2018-10-31 01:05:26 [DEBUG   ] Got command RPT from MCS: ref #326746
2018-10-31 01:05:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326746  77 58422  3926381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:05:26 [DEBUG   ] Got command RPT from MCS: ref #326748
2018-10-31 01:05:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326748  12 58422  3926573 A  ERRORB˘ff'
2018-10-31 01:05:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:05:40 [DEBUG   ] Got command RPT from MCS: ref #326752
2018-10-31 01:05:40 [DEBUG   ] summary = ERROR
2018-10-31 01:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326752  13 58422  3940005 A  ERRORERROR'
2018-10-31 01:05:40 [DEBUG   ] Got command RPT from MCS: ref #326753
2018-10-31 01:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326753  77 58422  3940006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:05:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:06:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:06:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:06:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:06:07 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-10-31 01:06:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:06:21 [DEBUG   ] Got command BAM from MCS: ref #326769
2018-10-31 01:06:21 [INFO    ] Finished processing BAM request
2018-10-31 01:06:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326769   8 58422  3981033 A  ERROR'
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:06:21 [DEBUG   ] spawn_process: at 2018-10-31 01:06:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:06:32 [DEBUG   ] Got command BAM from MCS: ref #326770
2018-10-31 01:06:32 [INFO    ] Finished processing BAM request
2018-10-31 01:06:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:06:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326770   8 58422  3992029 A  ERROR'
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:06:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:06:32 [DEBUG   ] spawn_process: at 2018-10-31 01:06:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:06:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:06:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:07:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 01:07:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:07:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:07:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:07:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:07:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:07:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:07:07 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-10-31 01:07:14 [DEBUG   ] Got command BAM from MCS: ref #326776
2018-10-31 01:07:14 [INFO    ] Finished processing BAM request
2018-10-31 01:07:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326776   8 58422  4034029 A  ERROR'
2018-10-31 01:07:14 [DEBUG   ] Got command BAM from MCS: ref #326775
2018-10-31 01:07:14 [INFO    ] Finished processing BAM request
2018-10-31 01:07:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326775   8 58422  4034033 A  ERROR'
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:07:14 [DEBUG   ] spawn_process: at 2018-10-31 01:07:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:07:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:07:37 [DEBUG   ] Got command BAM from MCS: ref #326779
2018-10-31 01:07:37 [INFO    ] Finished processing BAM request
2018-10-31 01:07:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326779   8 58422  4057029 A  ERROR'
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:07:37 [DEBUG   ] spawn_process: at 2018-10-31 01:07:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:07:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:07:42 [DEBUG   ] Got command BAM from MCS: ref #326780
2018-10-31 01:07:42 [INFO    ] Finished processing BAM request
2018-10-31 01:07:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326780   8 58422  4062033 A  ERROR'
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:07:42 [DEBUG   ] spawn_process: at 2018-10-31 01:07:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:07:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:08:00 [DEBUG   ] Got command BAM from MCS: ref #326781
2018-10-31 01:08:00 [INFO    ] Finished processing BAM request
2018-10-31 01:08:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326781   8 58422  4080025 A  ERROR'
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:08:00 [DEBUG   ] spawn_process: at 2018-10-31 01:08:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:08:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:08:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:08:07 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-10-31 01:08:10 [DEBUG   ] Got command BAM from MCS: ref #326782
2018-10-31 01:08:10 [INFO    ] Finished processing BAM request
2018-10-31 01:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326782   8 58422  4090029 A  ERROR'
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:08:10 [DEBUG   ] spawn_process: at 2018-10-31 01:08:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:08:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:08:23 [DEBUG   ] Got command BAM from MCS: ref #326783
2018-10-31 01:08:23 [INFO    ] Finished processing BAM request
2018-10-31 01:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326783   8 58422  4103033 A  ERROR'
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:08:23 [DEBUG   ] spawn_process: at 2018-10-31 01:08:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:08:38 [DEBUG   ] Got command BAM from MCS: ref #326784
2018-10-31 01:08:38 [INFO    ] Finished processing BAM request
2018-10-31 01:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326784   8 58422  4118025 A  ERROR'
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:08:38 [DEBUG   ] spawn_process: at 2018-10-31 01:08:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:08:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:08:46 [DEBUG   ] Got command BAM from MCS: ref #326785
2018-10-31 01:08:46 [INFO    ] Finished processing BAM request
2018-10-31 01:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326785   8 58422  4126033 A  ERROR'
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:08:46 [DEBUG   ] spawn_process: at 2018-10-31 01:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:08:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:09:06 [DEBUG   ] Got command BAM from MCS: ref #326786
2018-10-31 01:09:06 [INFO    ] Finished processing BAM request
2018-10-31 01:09:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326786   8 58422  4146029 A  ERROR'
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:09:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:09:06 [DEBUG   ] spawn_process: at 2018-10-31 01:09:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 01:09:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 01:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:09:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:09:07 [DEBUG   ] Finished updating board flags in 1.259 seconds
2018-10-31 01:09:09 [DEBUG   ] Got command BAM from MCS: ref #326787
2018-10-31 01:09:09 [INFO    ] Finished processing BAM request
2018-10-31 01:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326787   8 58422  4149029 A  ERROR'
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:09:09 [DEBUG   ] spawn_process: at 2018-10-31 01:09:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:09:14 [DEBUG   ] Got command BAM from MCS: ref #326789
2018-10-31 01:09:14 [INFO    ] Finished processing BAM request
2018-10-31 01:09:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326789   8 58422  4154029 A  ERROR'
2018-10-31 01:09:14 [DEBUG   ] Got command BAM from MCS: ref #326788
2018-10-31 01:09:14 [INFO    ] Finished processing BAM request
2018-10-31 01:09:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326788   8 58422  4154033 A  ERROR'
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:09:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:09:14 [DEBUG   ] spawn_process: at 2018-10-31 01:09:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:09:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:09:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:09:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:10:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:10:08 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-10-31 01:10:19 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2018-10-31 01:10:23 [DEBUG   ] Got command BAM from MCS: ref #326796
2018-10-31 01:10:23 [INFO    ] Finished processing BAM request
2018-10-31 01:10:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326796   8 58422  4223029 A  ERROR'
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:10:23 [DEBUG   ] spawn_process: at 2018-10-31 01:10:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:10:25 [DEBUG   ] Got command RPT from MCS: ref #326798
2018-10-31 01:10:25 [DEBUG   ] summary = ERROR
2018-10-31 01:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326798  13 58422  4225861 A  ERRORERROR'
2018-10-31 01:10:26 [DEBUG   ] Got command BAM from MCS: ref #326797
2018-10-31 01:10:26 [INFO    ] Finished processing BAM request
2018-10-31 01:10:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326797   8 58422  4226033 A  ERROR'
2018-10-31 01:10:26 [DEBUG   ] Got command RPT from MCS: ref #326799
2018-10-31 01:10:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326799  77 58422  4226057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:10:26 [DEBUG   ] Got command RPT from MCS: ref #326800
2018-10-31 01:10:26 [DEBUG   ] summary = ERROR
2018-10-31 01:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326800  13 58422  4226261 A  ERRORERROR'
2018-10-31 01:10:26 [DEBUG   ] Got command RPT from MCS: ref #326801
2018-10-31 01:10:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326801  77 58422  4226486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:10:26 [DEBUG   ] Got command RPT from MCS: ref #326802
2018-10-31 01:10:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326802  12 58422  4226665 A  ERRORB˘ff'
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:10:26 [DEBUG   ] spawn_process: at 2018-10-31 01:10:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:10:40 [DEBUG   ] Got command RPT from MCS: ref #326803
2018-10-31 01:10:40 [DEBUG   ] summary = ERROR
2018-10-31 01:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326803  13 58422  4240009 A  ERRORERROR'
2018-10-31 01:10:40 [DEBUG   ] Got command RPT from MCS: ref #326804
2018-10-31 01:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326804  77 58422  4240010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:10:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:11:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:11:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:11:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:11:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:11:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:11:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:11:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:11:07 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-10-31 01:11:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:11:32 [DEBUG   ] Got command BAM from MCS: ref #326820
2018-10-31 01:11:32 [INFO    ] Finished processing BAM request
2018-10-31 01:11:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326820   8 58422  4292033 A  ERROR'
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:11:32 [DEBUG   ] spawn_process: at 2018-10-31 01:11:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:11:38 [DEBUG   ] Got command BAM from MCS: ref #326821
2018-10-31 01:11:38 [INFO    ] Finished processing BAM request
2018-10-31 01:11:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326821   8 58422  4298025 A  ERROR'
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:11:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:11:38 [DEBUG   ] spawn_process: at 2018-10-31 01:11:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:11:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:12:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:12:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:12:07 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-10-31 01:12:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:12:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:12:41 [DEBUG   ] Got command BAM from MCS: ref #326822
2018-10-31 01:12:41 [INFO    ] Finished processing BAM request
2018-10-31 01:12:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326822   8 58422  4361029 A  ERROR'
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:12:41 [DEBUG   ] spawn_process: at 2018-10-31 01:12:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:12:50 [DEBUG   ] Got command BAM from MCS: ref #326827
2018-10-31 01:12:50 [INFO    ] Finished processing BAM request
2018-10-31 01:12:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:12:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326827   8 58422  4370033 A  ERROR'
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:12:50 [DEBUG   ] spawn_process: at 2018-10-31 01:12:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:13:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 01:13:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 01:13:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:13:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:13:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:13:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:13:07 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-10-31 01:13:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:13:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:13:50 [DEBUG   ] Got command BAM from MCS: ref #326828
2018-10-31 01:13:50 [INFO    ] Finished processing BAM request
2018-10-31 01:13:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326828   8 58422  4430025 A  ERROR'
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:13:50 [DEBUG   ] spawn_process: at 2018-10-31 01:13:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:14:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:14:02 [DEBUG   ] Got command BAM from MCS: ref #326829
2018-10-31 01:14:02 [INFO    ] Finished processing BAM request
2018-10-31 01:14:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326829   8 58422  4442029 A  ERROR'
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:14:02 [DEBUG   ] spawn_process: at 2018-10-31 01:14:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 01:14:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:14:07 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-10-31 01:14:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:14:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:14:59 [DEBUG   ] Got command BAM from MCS: ref #326830
2018-10-31 01:14:59 [INFO    ] Finished processing BAM request
2018-10-31 01:14:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326830   8 58422  4499029 A  ERROR'
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:14:59 [DEBUG   ] spawn_process: at 2018-10-31 01:14:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:15:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:15:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-31 01:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:15:07 [DEBUG   ] Finished updating board flags in 0.922 seconds
2018-10-31 01:15:14 [DEBUG   ] Got command BAM from MCS: ref #326833
2018-10-31 01:15:14 [INFO    ] Finished processing BAM request
2018-10-31 01:15:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326833   8 58422  4514025 A  ERROR'
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:15:14 [DEBUG   ] spawn_process: at 2018-10-31 01:15:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:15:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:15:25 [DEBUG   ] Got command RPT from MCS: ref #326834
2018-10-31 01:15:25 [DEBUG   ] summary = ERROR
2018-10-31 01:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326834  13 58422  4525941 A  ERRORERROR'
2018-10-31 01:15:26 [DEBUG   ] Got command RPT from MCS: ref #326835
2018-10-31 01:15:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326835  77 58422  4526145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:15:26 [DEBUG   ] Got command RPT from MCS: ref #326836
2018-10-31 01:15:26 [DEBUG   ] summary = ERROR
2018-10-31 01:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326836  13 58422  4526349 A  ERRORERROR'
2018-10-31 01:15:26 [DEBUG   ] Got command RPT from MCS: ref #326838
2018-10-31 01:15:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326838  77 58422  4526553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:15:26 [DEBUG   ] Got command RPT from MCS: ref #326839
2018-10-31 01:15:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326839  12 58422  4526745 A  ERRORB˘ff'
2018-10-31 01:15:40 [DEBUG   ] Got command RPT from MCS: ref #326844
2018-10-31 01:15:40 [DEBUG   ] summary = ERROR
2018-10-31 01:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326844  13 58422  4540005 A  ERRORERROR'
2018-10-31 01:15:40 [DEBUG   ] Got command RPT from MCS: ref #326845
2018-10-31 01:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326845  77 58422  4540006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:15:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:16:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:16:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:16:08 [DEBUG   ] Got command BAM from MCS: ref #326865
2018-10-31 01:16:08 [INFO    ] Finished processing BAM request
2018-10-31 01:16:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:16:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326865   8 58422  4568026 A  ERROR'
2018-10-31 01:16:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:16:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:16:08 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:16:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:16:08 [DEBUG   ] spawn_process: at 2018-10-31 01:16:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:16:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:16:26 [DEBUG   ] Got command BAM from MCS: ref #326866
2018-10-31 01:16:26 [INFO    ] Finished processing BAM request
2018-10-31 01:16:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326866   8 58422  4586025 A  ERROR'
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:16:26 [DEBUG   ] spawn_process: at 2018-10-31 01:16:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:16:40 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2018-10-31 01:17:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:17:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:17:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:17:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:17:08 [DEBUG   ] Finished updating board flags in 1.146 seconds
2018-10-31 01:17:17 [DEBUG   ] Got command BAM from MCS: ref #326867
2018-10-31 01:17:17 [INFO    ] Finished processing BAM request
2018-10-31 01:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326867   8 58422  4637033 A  ERROR'
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:17:17 [DEBUG   ] spawn_process: at 2018-10-31 01:17:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:17:20 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-31 01:17:39 [DEBUG   ] Got command BAM from MCS: ref #326868
2018-10-31 01:17:39 [INFO    ] Finished processing BAM request
2018-10-31 01:17:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326868   8 58422  4659033 A  ERROR'
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:17:39 [DEBUG   ] spawn_process: at 2018-10-31 01:17:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:17:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:18:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-31 01:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:18:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:18:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:18:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:18:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:18:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:18:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:18:08 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-10-31 01:18:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:18:26 [DEBUG   ] Got command BAM from MCS: ref #326869
2018-10-31 01:18:26 [INFO    ] Finished processing BAM request
2018-10-31 01:18:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326869   8 58422  4706034 A  ERROR'
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:18:26 [DEBUG   ] spawn_process: at 2018-10-31 01:18:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:18:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:18:52 [DEBUG   ] Got command BAM from MCS: ref #326874
2018-10-31 01:18:52 [INFO    ] Finished processing BAM request
2018-10-31 01:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326874   8 58422  4732030 A  ERROR'
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:18:52 [DEBUG   ] spawn_process: at 2018-10-31 01:18:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:19:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 01:19:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:19:09 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-31 01:19:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:19:35 [DEBUG   ] Got command BAM from MCS: ref #326875
2018-10-31 01:19:35 [INFO    ] Finished processing BAM request
2018-10-31 01:19:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326875   8 58422  4775033 A  ERROR'
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:19:35 [DEBUG   ] spawn_process: at 2018-10-31 01:19:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:19:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 01:20:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:20:05 [DEBUG   ] Got command BAM from MCS: ref #326876
2018-10-31 01:20:05 [INFO    ] Finished processing BAM request
2018-10-31 01:20:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326876   8 58422  4805033 A  ERROR'
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:20:05 [DEBUG   ] spawn_process: at 2018-10-31 01:20:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:20:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-10-31 01:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:20:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:20:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:20:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:20:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:20:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:20:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:20:08 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-10-31 01:20:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:20:26 [DEBUG   ] Got command RPT from MCS: ref #326877
2018-10-31 01:20:26 [DEBUG   ] summary = ERROR
2018-10-31 01:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326877  13 58422  4826033 A  ERRORERROR'
2018-10-31 01:20:26 [DEBUG   ] Got command RPT from MCS: ref #326878
2018-10-31 01:20:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326878  77 58422  4826237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:20:26 [DEBUG   ] Got command RPT from MCS: ref #326879
2018-10-31 01:20:26 [DEBUG   ] summary = ERROR
2018-10-31 01:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326879  13 58422  4826441 A  ERRORERROR'
2018-10-31 01:20:26 [DEBUG   ] Got command RPT from MCS: ref #326880
2018-10-31 01:20:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326880  77 58422  4826633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:20:26 [DEBUG   ] Got command RPT from MCS: ref #326881
2018-10-31 01:20:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326881  12 58422  4826837 A  ERRORBŁff'
2018-10-31 01:20:40 [DEBUG   ] Got command RPT from MCS: ref #326882
2018-10-31 01:20:40 [DEBUG   ] summary = ERROR
2018-10-31 01:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326882  13 58422  4840009 A  ERRORERROR'
2018-10-31 01:20:40 [DEBUG   ] Got command RPT from MCS: ref #326883
2018-10-31 01:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326883  77 58422  4840010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:20:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:20:44 [DEBUG   ] Got command BAM from MCS: ref #326899
2018-10-31 01:20:44 [INFO    ] Finished processing BAM request
2018-10-31 01:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326899   8 58422  4844033 A  ERROR'
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:20:44 [DEBUG   ] spawn_process: at 2018-10-31 01:20:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:21:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-31 01:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:21:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:21:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:21:08 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-31 01:21:18 [DEBUG   ] Got command BAM from MCS: ref #326900
2018-10-31 01:21:18 [INFO    ] Finished processing BAM request
2018-10-31 01:21:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326900   8 58422  4878025 A  ERROR'
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:21:18 [DEBUG   ] spawn_process: at 2018-10-31 01:21:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:21:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:21:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:21:54 [DEBUG   ] Got command BAM from MCS: ref #326905
2018-10-31 01:21:54 [INFO    ] Finished processing BAM request
2018-10-31 01:21:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326905   8 58422  4914033 A  ERROR'
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:21:54 [DEBUG   ] spawn_process: at 2018-10-31 01:21:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:22:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:22:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-31 01:22:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:22:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:22:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:22:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:22:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:22:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:22:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:22:08 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-10-31 01:22:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:22:31 [DEBUG   ] Got command BAM from MCS: ref #326906
2018-10-31 01:22:31 [INFO    ] Finished processing BAM request
2018-10-31 01:22:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326906   8 58422  4951029 A  ERROR'
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:22:31 [DEBUG   ] spawn_process: at 2018-10-31 01:22:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:22:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:23:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:23:04 [DEBUG   ] Got command BAM from MCS: ref #326907
2018-10-31 01:23:04 [INFO    ] Finished processing BAM request
2018-10-31 01:23:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326907   8 58422  4984025 A  ERROR'
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:23:04 [DEBUG   ] spawn_process: at 2018-10-31 01:23:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:23:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:23:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:23:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:23:08 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-10-31 01:23:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 01:23:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:23:44 [DEBUG   ] Got command BAM from MCS: ref #326908
2018-10-31 01:23:44 [INFO    ] Finished processing BAM request
2018-10-31 01:23:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326908   8 58422  5024025 A  ERROR'
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:23:44 [DEBUG   ] spawn_process: at 2018-10-31 01:23:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:24:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 01:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-31 01:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:24:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:24:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:24:08 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-10-31 01:24:14 [DEBUG   ] Got command BAM from MCS: ref #326909
2018-10-31 01:24:14 [INFO    ] Finished processing BAM request
2018-10-31 01:24:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326909   8 58422  5054025 A  ERROR'
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:24:14 [DEBUG   ] spawn_process: at 2018-10-31 01:24:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:24:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 01:24:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:24:57 [DEBUG   ] Got command BAM from MCS: ref #326914
2018-10-31 01:24:57 [INFO    ] Finished processing BAM request
2018-10-31 01:24:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326914   8 58422  5097029 A  ERROR'
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:24:57 [DEBUG   ] spawn_process: at 2018-10-31 01:24:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:25:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 01:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:25:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:25:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:25:08 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-31 01:25:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 01:25:24 [DEBUG   ] Got command BAM from MCS: ref #326917
2018-10-31 01:25:24 [INFO    ] Finished processing BAM request
2018-10-31 01:25:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326917   8 58422  5124033 A  ERROR'
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:25:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:25:24 [DEBUG   ] spawn_process: at 2018-10-31 01:25:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:25:26 [DEBUG   ] Got command RPT from MCS: ref #326918
2018-10-31 01:25:26 [DEBUG   ] summary = ERROR
2018-10-31 01:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326918  13 58422  5126121 A  ERRORERROR'
2018-10-31 01:25:26 [DEBUG   ] Got command RPT from MCS: ref #326919
2018-10-31 01:25:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326919  77 58422  5126325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:25:26 [DEBUG   ] Got command RPT from MCS: ref #326920
2018-10-31 01:25:26 [DEBUG   ] summary = ERROR
2018-10-31 01:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326920  13 58422  5126517 A  ERRORERROR'
2018-10-31 01:25:26 [DEBUG   ] Got command RPT from MCS: ref #326922
2018-10-31 01:25:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326922  77 58422  5126721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:25:26 [DEBUG   ] Got command RPT from MCS: ref #326924
2018-10-31 01:25:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326924  12 58422  5126925 A  ERRORB¤ff'
2018-10-31 01:25:40 [DEBUG   ] Got command RPT from MCS: ref #326928
2018-10-31 01:25:40 [DEBUG   ] summary = ERROR
2018-10-31 01:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326928  13 58422  5140005 A  ERRORERROR'
2018-10-31 01:25:40 [DEBUG   ] Got command RPT from MCS: ref #326929
2018-10-31 01:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326929  77 58422  5140006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:25:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:26:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 01:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:26:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:26:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-31 01:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:26:08 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-10-31 01:26:10 [DEBUG   ] Got command BAM from MCS: ref #326945
2018-10-31 01:26:10 [INFO    ] Finished processing BAM request
2018-10-31 01:26:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326945   8 58422  5170025 A  ERROR'
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:26:10 [DEBUG   ] spawn_process: at 2018-10-31 01:26:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:26:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:26:34 [DEBUG   ] Got command BAM from MCS: ref #326946
2018-10-31 01:26:34 [INFO    ] Finished processing BAM request
2018-10-31 01:26:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326946   8 58422  5194025 A  ERROR'
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:26:34 [DEBUG   ] spawn_process: at 2018-10-31 01:26:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:26:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:27:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 01:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-31 01:27:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:27:09 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-10-31 01:27:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:27:23 [DEBUG   ] Got command BAM from MCS: ref #326947
2018-10-31 01:27:23 [INFO    ] Finished processing BAM request
2018-10-31 01:27:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326947   8 58422  5243033 A  ERROR'
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:27:23 [DEBUG   ] spawn_process: at 2018-10-31 01:27:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:27:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:27:44 [DEBUG   ] Got command BAM from MCS: ref #326948
2018-10-31 01:27:44 [INFO    ] Finished processing BAM request
2018-10-31 01:27:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:27:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326948   8 58422  5264025 A  ERROR'
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:27:44 [DEBUG   ] spawn_process: at 2018-10-31 01:27:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:28:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:28:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:28:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:28:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:28:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:28:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:28:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:28:09 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-10-31 01:28:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:28:36 [DEBUG   ] Got command BAM from MCS: ref #326953
2018-10-31 01:28:36 [INFO    ] Finished processing BAM request
2018-10-31 01:28:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326953   8 58422  5316025 A  ERROR'
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:28:36 [DEBUG   ] spawn_process: at 2018-10-31 01:28:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:28:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:28:54 [DEBUG   ] Got command BAM from MCS: ref #326954
2018-10-31 01:28:54 [INFO    ] Finished processing BAM request
2018-10-31 01:28:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326954   8 58422  5334025 A  ERROR'
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:28:54 [DEBUG   ] spawn_process: at 2018-10-31 01:28:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:29:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:29:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:29:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:29:09 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-10-31 01:29:14 [DEBUG   ] Got command BAM from MCS: ref #326955
2018-10-31 01:29:14 [INFO    ] Finished processing BAM request
2018-10-31 01:29:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326955   8 58422  5354025 A  ERROR'
2018-10-31 01:29:14 [DEBUG   ] Got command BAM from MCS: ref #326956
2018-10-31 01:29:14 [INFO    ] Finished processing BAM request
2018-10-31 01:29:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326956   8 58422  5354029 A  ERROR'
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:29:14 [DEBUG   ] spawn_process: at 2018-10-31 01:29:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:29:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:29:38 [DEBUG   ] Got command BAM from MCS: ref #326959
2018-10-31 01:29:38 [INFO    ] Finished processing BAM request
2018-10-31 01:29:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326959   8 58422  5378029 A  ERROR'
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:29:38 [DEBUG   ] spawn_process: at 2018-10-31 01:29:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:29:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:29:43 [DEBUG   ] Got command BAM from MCS: ref #326960
2018-10-31 01:29:43 [INFO    ] Finished processing BAM request
2018-10-31 01:29:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326960   8 58422  5383025 A  ERROR'
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:29:43 [DEBUG   ] spawn_process: at 2018-10-31 01:29:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:30:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:30:02 [DEBUG   ] Got command BAM from MCS: ref #326961
2018-10-31 01:30:02 [INFO    ] Finished processing BAM request
2018-10-31 01:30:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326961   8 58422  5402033 A  ERROR'
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:30:02 [DEBUG   ] spawn_process: at 2018-10-31 01:30:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 01:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:30:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:30:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-31 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:30:09 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-10-31 01:30:12 [DEBUG   ] Got command BAM from MCS: ref #326962
2018-10-31 01:30:12 [INFO    ] Finished processing BAM request
2018-10-31 01:30:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326962   8 58422  5412025 A  ERROR'
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:30:12 [DEBUG   ] spawn_process: at 2018-10-31 01:30:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:30:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:30:26 [DEBUG   ] Got command BAM from MCS: ref #326963
2018-10-31 01:30:26 [INFO    ] Finished processing BAM request
2018-10-31 01:30:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326963   8 58422  5426029 A  ERROR'
2018-10-31 01:30:26 [DEBUG   ] Got command RPT from MCS: ref #326964
2018-10-31 01:30:26 [DEBUG   ] summary = ERROR
2018-10-31 01:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326964  13 58422  5426209 A  ERRORERROR'
2018-10-31 01:30:26 [DEBUG   ] Got command RPT from MCS: ref #326965
2018-10-31 01:30:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326965  77 58422  5426401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:30:26 [DEBUG   ] Got command RPT from MCS: ref #326966
2018-10-31 01:30:26 [DEBUG   ] summary = ERROR
2018-10-31 01:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326966  13 58422  5426605 A  ERRORERROR'
2018-10-31 01:30:26 [DEBUG   ] Got command RPT from MCS: ref #326967
2018-10-31 01:30:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326967  77 58422  5426809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:30:26 [DEBUG   ] spawn_process: at 2018-10-31 01:30:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:30:27 [DEBUG   ] Got command RPT from MCS: ref #326968
2018-10-31 01:30:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326968  12 58422  5427005 A  ERRORB¤ff'
2018-10-31 01:30:40 [DEBUG   ] Got command RPT from MCS: ref #326969
2018-10-31 01:30:40 [DEBUG   ] summary = ERROR
2018-10-31 01:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326969  13 58422  5440013 A  ERRORERROR'
2018-10-31 01:30:40 [DEBUG   ] Got command RPT from MCS: ref #326970
2018-10-31 01:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   326970  77 58422  5440014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:30:41 [DEBUG   ] Got command BAM from MCS: ref #326986
2018-10-31 01:30:41 [INFO    ] Finished processing BAM request
2018-10-31 01:30:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:30:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326986   8 58422  5441025 A  ERROR'
2018-10-31 01:30:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:30:41 [DEBUG   ] spawn_process: at 2018-10-31 01:30:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:30:50 [DEBUG   ] Got command BAM from MCS: ref #326991
2018-10-31 01:30:50 [INFO    ] Finished processing BAM request
2018-10-31 01:30:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326991   8 58422  5450033 A  ERROR'
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:30:50 [DEBUG   ] spawn_process: at 2018-10-31 01:30:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:31:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:31:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:31:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:31:09 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-31 01:31:11 [DEBUG   ] Got command BAM from MCS: ref #326992
2018-10-31 01:31:11 [INFO    ] Finished processing BAM request
2018-10-31 01:31:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326992   8 58422  5471029 A  ERROR'
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:31:11 [DEBUG   ] spawn_process: at 2018-10-31 01:31:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:31:14 [DEBUG   ] Got command BAM from MCS: ref #326994
2018-10-31 01:31:14 [INFO    ] Finished processing BAM request
2018-10-31 01:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326994   8 58422  5474025 A  ERROR'
2018-10-31 01:31:14 [DEBUG   ] Got command BAM from MCS: ref #326993
2018-10-31 01:31:14 [INFO    ] Finished processing BAM request
2018-10-31 01:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326993   8 58422  5474029 A  ERROR'
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:31:14 [DEBUG   ] spawn_process: at 2018-10-31 01:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:31:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:31:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:32:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:32:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:32:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:32:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:32:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:32:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:32:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:32:09 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-31 01:32:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:32:25 [DEBUG   ] Got command BAM from MCS: ref #326997
2018-10-31 01:32:25 [INFO    ] Finished processing BAM request
2018-10-31 01:32:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326997   8 58422  5545025 A  ERROR'
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:32:25 [DEBUG   ] spawn_process: at 2018-10-31 01:32:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:32:28 [DEBUG   ] Got command BAM from MCS: ref #326998
2018-10-31 01:32:28 [INFO    ] Finished processing BAM request
2018-10-31 01:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326998   8 58422  5548029 A  ERROR'
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:32:28 [DEBUG   ] spawn_process: at 2018-10-31 01:32:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:32:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:33:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:33:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:33:09 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-10-31 01:33:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:33:36 [DEBUG   ] Got command BAM from MCS: ref #326999
2018-10-31 01:33:36 [INFO    ] Finished processing BAM request
2018-10-31 01:33:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   326999   8 58422  5616025 A  ERROR'
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:33:36 [DEBUG   ] spawn_process: at 2018-10-31 01:33:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:33:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:33:42 [DEBUG   ] Got command BAM from MCS: ref #327000
2018-10-31 01:33:42 [INFO    ] Finished processing BAM request
2018-10-31 01:33:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327000   8 58422  5622033 A  ERROR'
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:33:42 [DEBUG   ] spawn_process: at 2018-10-31 01:33:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:34:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:34:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:34:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:34:10 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-31 01:34:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:34:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:34:47 [DEBUG   ] Got command BAM from MCS: ref #327005
2018-10-31 01:34:47 [INFO    ] Finished processing BAM request
2018-10-31 01:34:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:34:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327005   8 58422  5687033 A  ERROR'
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:34:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:34:47 [DEBUG   ] spawn_process: at 2018-10-31 01:34:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:34:56 [DEBUG   ] Got command BAM from MCS: ref #327006
2018-10-31 01:34:56 [INFO    ] Finished processing BAM request
2018-10-31 01:34:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327006   8 58422  5696025 A  ERROR'
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:34:56 [DEBUG   ] spawn_process: at 2018-10-31 01:34:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:35:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 01:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:35:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:35:09 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-31 01:35:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 01:35:26 [DEBUG   ] Got command RPT from MCS: ref #327009
2018-10-31 01:35:26 [DEBUG   ] summary = ERROR
2018-10-31 01:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327009  13 58422  5726293 A  ERRORERROR'
2018-10-31 01:35:26 [DEBUG   ] Got command RPT from MCS: ref #327010
2018-10-31 01:35:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327010  77 58422  5726485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:35:26 [DEBUG   ] Got command RPT from MCS: ref #327011
2018-10-31 01:35:26 [DEBUG   ] summary = ERROR
2018-10-31 01:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327011  13 58422  5726689 A  ERRORERROR'
2018-10-31 01:35:26 [DEBUG   ] Got command RPT from MCS: ref #327013
2018-10-31 01:35:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327013  77 58422  5726893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:35:27 [DEBUG   ] Got command RPT from MCS: ref #327015
2018-10-31 01:35:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327015  12 58422  5727085 A  ERRORBŁff'
2018-10-31 01:35:40 [DEBUG   ] Got command RPT from MCS: ref #327019
2018-10-31 01:35:40 [DEBUG   ] summary = ERROR
2018-10-31 01:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327019  13 58422  5740013 A  ERRORERROR'
2018-10-31 01:35:40 [DEBUG   ] Got command RPT from MCS: ref #327020
2018-10-31 01:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327020  77 58422  5740014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:35:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:35:58 [DEBUG   ] Got command BAM from MCS: ref #327036
2018-10-31 01:35:58 [INFO    ] Finished processing BAM request
2018-10-31 01:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327036   8 58422  5758033 A  ERROR'
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:35:58 [DEBUG   ] spawn_process: at 2018-10-31 01:35:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:36:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:36:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:36:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:36:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:36:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:36:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:36:09 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-31 01:36:10 [DEBUG   ] Got command BAM from MCS: ref #327037
2018-10-31 01:36:10 [INFO    ] Finished processing BAM request
2018-10-31 01:36:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327037   8 58422  5770033 A  ERROR'
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:36:10 [DEBUG   ] spawn_process: at 2018-10-31 01:36:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:36:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:36:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:37:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:37:09 [DEBUG   ] Got command BAM from MCS: ref #327042
2018-10-31 01:37:09 [INFO    ] Finished processing BAM request
2018-10-31 01:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327042   8 58422  5829025 A  ERROR'
2018-10-31 01:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:37:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 01:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 01:37:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-31 01:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:37:09 [DEBUG   ] Finished updating board flags in 1.224 seconds
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:37:09 [DEBUG   ] spawn_process: at 2018-10-31 01:37:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:37:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:37:24 [DEBUG   ] Got command BAM from MCS: ref #327043
2018-10-31 01:37:24 [INFO    ] Finished processing BAM request
2018-10-31 01:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327043   8 58422  5844029 A  ERROR'
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:37:24 [DEBUG   ] spawn_process: at 2018-10-31 01:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:37:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:38:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 01:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-31 01:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:38:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:38:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:38:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:38:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:38:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:38:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:38:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:38:10 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-31 01:38:20 [DEBUG   ] Got command BAM from MCS: ref #327044
2018-10-31 01:38:20 [INFO    ] Finished processing BAM request
2018-10-31 01:38:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327044   8 58422  5900025 A  ERROR'
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:38:20 [DEBUG   ] spawn_process: at 2018-10-31 01:38:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:38:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:38:38 [DEBUG   ] Got command BAM from MCS: ref #327045
2018-10-31 01:38:38 [INFO    ] Finished processing BAM request
2018-10-31 01:38:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327045   8 58422  5918025 A  ERROR'
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:38:38 [DEBUG   ] spawn_process: at 2018-10-31 01:38:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:38:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:39:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:39:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:39:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:39:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:39:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:39:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:39:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:39:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:39:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:39:10 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-31 01:39:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:39:31 [DEBUG   ] Got command BAM from MCS: ref #327046
2018-10-31 01:39:31 [INFO    ] Finished processing BAM request
2018-10-31 01:39:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327046   8 58422  5971029 A  ERROR'
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:39:31 [DEBUG   ] spawn_process: at 2018-10-31 01:39:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:39:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 01:39:52 [DEBUG   ] Got command BAM from MCS: ref #327051
2018-10-31 01:39:52 [INFO    ] Finished processing BAM request
2018-10-31 01:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327051   8 58422  5992033 A  ERROR'
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:39:52 [DEBUG   ] spawn_process: at 2018-10-31 01:39:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:40:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 01:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 01:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:40:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:40:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:40:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:40:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:40:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:40:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:40:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:40:10 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-31 01:40:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 01:40:26 [DEBUG   ] Got command RPT from MCS: ref #327052
2018-10-31 01:40:26 [DEBUG   ] summary = ERROR
2018-10-31 01:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327052  13 58422  6026377 A  ERRORERROR'
2018-10-31 01:40:26 [DEBUG   ] Got command RPT from MCS: ref #327053
2018-10-31 01:40:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327053  77 58422  6026569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:40:26 [DEBUG   ] Got command RPT from MCS: ref #327054
2018-10-31 01:40:26 [DEBUG   ] summary = ERROR
2018-10-31 01:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327054  13 58422  6026773 A  ERRORERROR'
2018-10-31 01:40:26 [DEBUG   ] Got command RPT from MCS: ref #327055
2018-10-31 01:40:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327055  77 58422  6026977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:40:27 [DEBUG   ] Got command RPT from MCS: ref #327056
2018-10-31 01:40:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327056  12 58422  6027181 A  ERRORBŁff'
2018-10-31 01:40:40 [DEBUG   ] Got command RPT from MCS: ref #327057
2018-10-31 01:40:40 [DEBUG   ] summary = ERROR
2018-10-31 01:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327057  13 58422  6040009 A  ERRORERROR'
2018-10-31 01:40:40 [DEBUG   ] Got command RPT from MCS: ref #327058
2018-10-31 01:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327058  77 58422  6040010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:40:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:40:43 [DEBUG   ] Got command BAM from MCS: ref #327074
2018-10-31 01:40:43 [INFO    ] Finished processing BAM request
2018-10-31 01:40:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:40:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327074   8 58422  6043029 A  ERROR'
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:40:43 [DEBUG   ] spawn_process: at 2018-10-31 01:40:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:41:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:41:07 [DEBUG   ] Got command BAM from MCS: ref #327075
2018-10-31 01:41:07 [INFO    ] Finished processing BAM request
2018-10-31 01:41:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327075   8 58422  6067033 A  ERROR'
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:41:07 [DEBUG   ] spawn_process: at 2018-10-31 01:41:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:41:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:41:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:41:10 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-10-31 01:41:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:41:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:41:55 [DEBUG   ] Got command BAM from MCS: ref #327076
2018-10-31 01:41:55 [INFO    ] Finished processing BAM request
2018-10-31 01:41:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327076   8 58422  6115033 A  ERROR'
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:41:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:41:55 [DEBUG   ] spawn_process: at 2018-10-31 01:41:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:42:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:42:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:42:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 01:42:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:42:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:42:10 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-10-31 01:42:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:42:22 [DEBUG   ] Got command BAM from MCS: ref #327077
2018-10-31 01:42:22 [INFO    ] Finished processing BAM request
2018-10-31 01:42:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327077   8 58422  6142029 A  ERROR'
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:42:22 [DEBUG   ] spawn_process: at 2018-10-31 01:42:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:42:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:43:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:43:07 [DEBUG   ] Got command BAM from MCS: ref #327082
2018-10-31 01:43:07 [INFO    ] Finished processing BAM request
2018-10-31 01:43:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327082   8 58422  6187029 A  ERROR'
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:43:07 [DEBUG   ] spawn_process: at 2018-10-31 01:43:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-31 01:43:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:43:10 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-31 01:43:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:43:37 [DEBUG   ] Got command BAM from MCS: ref #327083
2018-10-31 01:43:37 [INFO    ] Finished processing BAM request
2018-10-31 01:43:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327083   8 58422  6217029 A  ERROR'
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:43:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:43:37 [DEBUG   ] spawn_process: at 2018-10-31 01:43:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:43:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:44:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 01:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:44:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:44:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:44:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:44:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:44:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:44:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:44:10 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-10-31 01:44:17 [DEBUG   ] Got command BAM from MCS: ref #327084
2018-10-31 01:44:17 [INFO    ] Finished processing BAM request
2018-10-31 01:44:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327084   8 58422  6257033 A  ERROR'
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:44:17 [DEBUG   ] spawn_process: at 2018-10-31 01:44:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:44:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:44:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 01:44:52 [DEBUG   ] Got command BAM from MCS: ref #327085
2018-10-31 01:44:52 [INFO    ] Finished processing BAM request
2018-10-31 01:44:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327085   8 58422  6292029 A  ERROR'
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:44:52 [DEBUG   ] spawn_process: at 2018-10-31 01:44:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:45:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 01:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:45:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 01:45:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:45:10 [DEBUG   ] Finished updating board flags in 1.167 seconds
2018-10-31 01:45:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 01:45:25 [DEBUG   ] Got command BAM from MCS: ref #327088
2018-10-31 01:45:25 [INFO    ] Finished processing BAM request
2018-10-31 01:45:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327088   8 58422  6325029 A  ERROR'
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:45:25 [DEBUG   ] spawn_process: at 2018-10-31 01:45:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:45:26 [DEBUG   ] Got command RPT from MCS: ref #327089
2018-10-31 01:45:26 [DEBUG   ] summary = ERROR
2018-10-31 01:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327089  13 58422  6326457 A  ERRORERROR'
2018-10-31 01:45:26 [DEBUG   ] Got command RPT from MCS: ref #327090
2018-10-31 01:45:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327090  77 58422  6326669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:45:26 [DEBUG   ] Got command RPT from MCS: ref #327091
2018-10-31 01:45:26 [DEBUG   ] summary = ERROR
2018-10-31 01:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327091  13 58422  6326861 A  ERRORERROR'
2018-10-31 01:45:27 [DEBUG   ] Got command RPT from MCS: ref #327093
2018-10-31 01:45:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327093  77 58422  6327065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:45:27 [DEBUG   ] Got command RPT from MCS: ref #327095
2018-10-31 01:45:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327095  12 58422  6327257 A  ERRORB˘ff'
2018-10-31 01:45:40 [DEBUG   ] Got command RPT from MCS: ref #327099
2018-10-31 01:45:40 [DEBUG   ] summary = ERROR
2018-10-31 01:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327099  13 58422  6340017 A  ERRORERROR'
2018-10-31 01:45:40 [DEBUG   ] Got command RPT from MCS: ref #327100
2018-10-31 01:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327100  77 58422  6340018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:45:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:46:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 01:46:07 [DEBUG   ] Got command BAM from MCS: ref #327120
2018-10-31 01:46:07 [INFO    ] Finished processing BAM request
2018-10-31 01:46:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:46:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327120   8 58422  6367033 A  ERROR'
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:46:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:46:07 [DEBUG   ] spawn_process: at 2018-10-31 01:46:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:46:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:46:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:46:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:46:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:46:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:46:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:46:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:46:10 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-10-31 01:46:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 01:46:31 [DEBUG   ] Got command BAM from MCS: ref #327121
2018-10-31 01:46:31 [INFO    ] Finished processing BAM request
2018-10-31 01:46:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327121   8 58422  6391025 A  ERROR'
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:46:31 [DEBUG   ] spawn_process: at 2018-10-31 01:46:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:46:41 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 01:47:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 01:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 01:47:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-31 01:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:47:10 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-10-31 01:47:22 [DEBUG   ] Got command BAM from MCS: ref #327122
2018-10-31 01:47:22 [INFO    ] Finished processing BAM request
2018-10-31 01:47:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327122   8 58422  6442025 A  ERROR'
2018-10-31 01:47:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:47:22 [DEBUG   ] spawn_process: at 2018-10-31 01:47:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:47:36 [DEBUG   ] Got command BAM from MCS: ref #327123
2018-10-31 01:47:36 [INFO    ] Finished processing BAM request
2018-10-31 01:47:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327123   8 58422  6456033 A  ERROR'
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:47:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:47:36 [DEBUG   ] spawn_process: at 2018-10-31 01:47:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:47:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:48:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:48:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-31 01:48:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:48:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:48:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:48:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:48:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:48:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:48:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:48:11 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-31 01:48:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:48:37 [DEBUG   ] Got command BAM from MCS: ref #327124
2018-10-31 01:48:37 [INFO    ] Finished processing BAM request
2018-10-31 01:48:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327124   8 58422  6517033 A  ERROR'
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:48:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:48:37 [DEBUG   ] spawn_process: at 2018-10-31 01:48:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:48:39 [DEBUG   ] Got command BAM from MCS: ref #327125
2018-10-31 01:48:39 [INFO    ] Finished processing BAM request
2018-10-31 01:48:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327125   8 58422  6519029 A  ERROR'
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:48:39 [DEBUG   ] spawn_process: at 2018-10-31 01:48:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:48:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:49:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:49:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:49:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 01:49:11 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:49:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:49:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:49:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:49:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:49:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:49:11 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-31 01:49:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 01:49:41 [DEBUG   ] Got command BAM from MCS: ref #327130
2018-10-31 01:49:41 [INFO    ] Finished processing BAM request
2018-10-31 01:49:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327130   8 58422  6581025 A  ERROR'
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:49:41 [DEBUG   ] spawn_process: at 2018-10-31 01:49:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:49:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:49:53 [DEBUG   ] Got command BAM from MCS: ref #327131
2018-10-31 01:49:53 [INFO    ] Finished processing BAM request
2018-10-31 01:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327131   8 58422  6593025 A  ERROR'
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:49:53 [DEBUG   ] spawn_process: at 2018-10-31 01:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:50:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 01:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:50:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:50:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:50:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:50:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:50:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:50:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:50:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:50:11 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-31 01:50:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 01:50:26 [DEBUG   ] Got command RPT from MCS: ref #327132
2018-10-31 01:50:26 [DEBUG   ] summary = ERROR
2018-10-31 01:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327132  13 58422  6626545 A  ERRORERROR'
2018-10-31 01:50:26 [DEBUG   ] Got command RPT from MCS: ref #327133
2018-10-31 01:50:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327133  77 58422  6626749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:50:26 [DEBUG   ] Got command RPT from MCS: ref #327134
2018-10-31 01:50:26 [DEBUG   ] summary = ERROR
2018-10-31 01:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327134  13 58422  6626941 A  ERRORERROR'
2018-10-31 01:50:27 [DEBUG   ] Got command RPT from MCS: ref #327135
2018-10-31 01:50:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327135  77 58422  6627145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:50:27 [DEBUG   ] Got command RPT from MCS: ref #327136
2018-10-31 01:50:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327136  12 58422  6627349 A  ERRORBŁff'
2018-10-31 01:50:40 [DEBUG   ] Got command RPT from MCS: ref #327137
2018-10-31 01:50:40 [DEBUG   ] summary = ERROR
2018-10-31 01:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327137  13 58422  6640017 A  ERRORERROR'
2018-10-31 01:50:40 [DEBUG   ] Got command RPT from MCS: ref #327138
2018-10-31 01:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327138  77 58422  6640018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:50:41 [DEBUG   ] Got command BAM from MCS: ref #327154
2018-10-31 01:50:41 [INFO    ] Finished processing BAM request
2018-10-31 01:50:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:50:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327154   8 58422  6641029 A  ERROR'
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:50:41 [DEBUG   ] spawn_process: at 2018-10-31 01:50:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:50:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:51:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:51:09 [DEBUG   ] Got command BAM from MCS: ref #327155
2018-10-31 01:51:09 [INFO    ] Finished processing BAM request
2018-10-31 01:51:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327155   8 58422  6669033 A  ERROR'
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:51:09 [DEBUG   ] spawn_process: at 2018-10-31 01:51:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:51:11 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:51:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:51:11 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-31 01:51:14 [DEBUG   ] Got command BAM from MCS: ref #327157
2018-10-31 01:51:14 [INFO    ] Finished processing BAM request
2018-10-31 01:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327157   8 58422  6674033 A  ERROR'
2018-10-31 01:51:14 [DEBUG   ] Got command BAM from MCS: ref #327156
2018-10-31 01:51:14 [INFO    ] Finished processing BAM request
2018-10-31 01:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327156   8 58422  6674037 A  ERROR'
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:51:14 [DEBUG   ] spawn_process: at 2018-10-31 01:51:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:51:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:51:42 [DEBUG   ] Got command BAM from MCS: ref #327160
2018-10-31 01:51:42 [INFO    ] Finished processing BAM request
2018-10-31 01:51:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327160   8 58422  6702025 A  ERROR'
2018-10-31 01:51:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:51:42 [DEBUG   ] spawn_process: at 2018-10-31 01:51:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:51:47 [DEBUG   ] Got command BAM from MCS: ref #327161
2018-10-31 01:51:47 [INFO    ] Finished processing BAM request
2018-10-31 01:51:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327161   8 58422  6707033 A  ERROR'
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 01:51:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 01:51:47 [DEBUG   ] spawn_process: at 2018-10-31 01:51:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 01:52:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:52:10 [DEBUG   ] Got command BAM from MCS: ref #327166
2018-10-31 01:52:10 [INFO    ] Finished processing BAM request
2018-10-31 01:52:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327166   8 58422  6730029 A  ERROR'
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:52:10 [DEBUG   ] spawn_process: at 2018-10-31 01:52:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-31 01:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-31 01:52:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-31 01:52:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:52:11 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-10-31 01:52:21 [DEBUG   ] Got command BAM from MCS: ref #327167
2018-10-31 01:52:21 [INFO    ] Finished processing BAM request
2018-10-31 01:52:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327167   8 58422  6741029 A  ERROR'
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 01:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 01:52:21 [DEBUG   ] spawn_process: at 2018-10-31 01:52:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 01:52:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:52:38 [DEBUG   ] Got command BAM from MCS: ref #327168
2018-10-31 01:52:38 [INFO    ] Finished processing BAM request
2018-10-31 01:52:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327168   8 58422  6758033 A  ERROR'
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:52:38 [DEBUG   ] spawn_process: at 2018-10-31 01:52:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:52:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:52:55 [DEBUG   ] Got command BAM from MCS: ref #327169
2018-10-31 01:52:55 [INFO    ] Finished processing BAM request
2018-10-31 01:52:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:52:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327169   8 58422  6775033 A  ERROR'
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 01:52:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 01:52:55 [DEBUG   ] spawn_process: at 2018-10-31 01:52:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 01:53:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:53:06 [DEBUG   ] Got command BAM from MCS: ref #327170
2018-10-31 01:53:06 [INFO    ] Finished processing BAM request
2018-10-31 01:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 01:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   327170   8 58422  6786025 A  ERROR'
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 01:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 01:53:06 [DEBUG   ] spawn_process: at 2018-10-31 01:53:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 01:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-31 01:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-31 01:53:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:53:11 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-31 01:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 01:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-31 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:53:11 [DEBUG   ] Finished updating board flags in 1.149 seconds
2018-10-31 01:53:16 [DEBUG   ] Got command STP from MCS: ref #327171
2018-10-31 01:53:16 [INFO    ] Finished processing BAM request
2018-10-31 01:53:16 [INFO    ] Shutdown the adder chain on beam #3
2018-10-31 01:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   327171   8 58422  6796397 A  ERROR'
2018-10-31 01:53:16 [DEBUG   ] Got command STP from MCS: ref #327172
2018-10-31 01:53:16 [INFO    ] Finished processing BAM request
2018-10-31 01:53:16 [INFO    ] Shutdown the adder chain on beam #2
2018-10-31 01:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   327172   8 58422  6796401 A  ERROR'
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 01:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 01:53:16 [DEBUG   ] spawn_process: at 2018-10-31 01:53:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 01:53:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:53:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:54:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 01:54:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:54:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:54:11 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-10-31 01:54:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:54:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:55:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:55:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:55:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:55:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:55:11 [WARNING ] (13, 1, 'bot')
2018-10-31 01:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:55:11 [DEBUG   ] Finished updating board flags in 1.305 seconds
2018-10-31 01:55:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:55:26 [DEBUG   ] Got command RPT from MCS: ref #327179
2018-10-31 01:55:26 [DEBUG   ] summary = ERROR
2018-10-31 01:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327179  13 58422  6926629 A  ERRORERROR'
2018-10-31 01:55:26 [DEBUG   ] Got command RPT from MCS: ref #327180
2018-10-31 01:55:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327180  77 58422  6926833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:55:27 [DEBUG   ] Got command RPT from MCS: ref #327181
2018-10-31 01:55:27 [DEBUG   ] summary = ERROR
2018-10-31 01:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327181  13 58422  6927037 A  ERRORERROR'
2018-10-31 01:55:27 [DEBUG   ] Got command RPT from MCS: ref #327183
2018-10-31 01:55:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327183  77 58422  6927229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:55:27 [DEBUG   ] Got command RPT from MCS: ref #327185
2018-10-31 01:55:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 01:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327185  12 58422  6927433 A  ERRORB'
2018-10-31 01:55:40 [DEBUG   ] Got command RPT from MCS: ref #327189
2018-10-31 01:55:40 [DEBUG   ] summary = ERROR
2018-10-31 01:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327189  13 58422  6940013 A  ERRORERROR'
2018-10-31 01:55:40 [DEBUG   ] Got command RPT from MCS: ref #327190
2018-10-31 01:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 01:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327190  77 58422  6940014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 01:55:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:56:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:56:12 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-10-31 01:56:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:56:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:57:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:57:12 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-31 01:57:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:57:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:58:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:58:12 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-31 01:58:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:58:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 01:59:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-31 01:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 01:59:12 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-10-31 01:59:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 01:59:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:00:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:00:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:00:12 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-10-31 02:00:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 02:00:26 [DEBUG   ] Got command RPT from MCS: ref #327210
2018-10-31 02:00:26 [DEBUG   ] summary = ERROR
2018-10-31 02:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327210  13 58422  7226713 A  ERRORERROR'
2018-10-31 02:00:26 [DEBUG   ] Got command RPT from MCS: ref #327211
2018-10-31 02:00:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327211  77 58422  7226917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:00:27 [DEBUG   ] Got command RPT from MCS: ref #327212
2018-10-31 02:00:27 [DEBUG   ] summary = ERROR
2018-10-31 02:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327212  13 58422  7227121 A  ERRORERROR'
2018-10-31 02:00:27 [DEBUG   ] Got command RPT from MCS: ref #327213
2018-10-31 02:00:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327213  77 58422  7227313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:00:27 [DEBUG   ] Got command RPT from MCS: ref #327214
2018-10-31 02:00:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327214  12 58422  7227517 A  ERRORB'
2018-10-31 02:00:40 [DEBUG   ] Got command RPT from MCS: ref #327215
2018-10-31 02:00:40 [DEBUG   ] summary = ERROR
2018-10-31 02:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327215  13 58422  7240009 A  ERRORERROR'
2018-10-31 02:00:40 [DEBUG   ] Got command RPT from MCS: ref #327216
2018-10-31 02:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327216  77 58422  7240010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:00:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:01:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:01:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:01:12 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-10-31 02:01:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:01:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:02:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:02:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:02:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:02:12 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-10-31 02:02:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:02:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:03:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:03:13 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-31 02:03:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:03:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:04:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:04:13 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-31 02:04:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:04:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:05:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:05:13 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-31 02:05:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:05:26 [DEBUG   ] Got command RPT from MCS: ref #327242
2018-10-31 02:05:26 [DEBUG   ] summary = ERROR
2018-10-31 02:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327242  13 58422  7526805 A  ERRORERROR'
2018-10-31 02:05:27 [DEBUG   ] Got command RPT from MCS: ref #327243
2018-10-31 02:05:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327243  77 58422  7527009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:05:27 [DEBUG   ] Got command RPT from MCS: ref #327244
2018-10-31 02:05:27 [DEBUG   ] summary = ERROR
2018-10-31 02:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327244  13 58422  7527201 A  ERRORERROR'
2018-10-31 02:05:27 [DEBUG   ] Got command RPT from MCS: ref #327246
2018-10-31 02:05:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327246  77 58422  7527405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:05:27 [DEBUG   ] Got command RPT from MCS: ref #327247
2018-10-31 02:05:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327247  12 58422  7527609 A  ERRORB'
2018-10-31 02:05:40 [DEBUG   ] Got command RPT from MCS: ref #327252
2018-10-31 02:05:40 [DEBUG   ] summary = ERROR
2018-10-31 02:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327252  13 58422  7540021 A  ERRORERROR'
2018-10-31 02:05:40 [DEBUG   ] Got command RPT from MCS: ref #327253
2018-10-31 02:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327253  77 58422  7540022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:05:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:06:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:06:13 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-10-31 02:06:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:06:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:07:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:07:12 [DEBUG   ] Finished updating board flags in 1.045 seconds
2018-10-31 02:07:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:07:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:08:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:08:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:08:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:08:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:08:12 [WARNING ] (13, 1, 'bot')
2018-10-31 02:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:08:12 [DEBUG   ] Finished updating board flags in 1.060 seconds
2018-10-31 02:08:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:08:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:09:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:09:13 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-10-31 02:09:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:09:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:10:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 02:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-31 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:10:13 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-31 02:10:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 02:10:26 [DEBUG   ] Got command RPT from MCS: ref #327277
2018-10-31 02:10:26 [DEBUG   ] summary = ERROR
2018-10-31 02:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327277  13 58422  7826893 A  ERRORERROR'
2018-10-31 02:10:27 [DEBUG   ] Got command RPT from MCS: ref #327278
2018-10-31 02:10:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327278  77 58422  7827097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:10:27 [DEBUG   ] Got command RPT from MCS: ref #327279
2018-10-31 02:10:27 [DEBUG   ] summary = ERROR
2018-10-31 02:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327279  13 58422  7827289 A  ERRORERROR'
2018-10-31 02:10:27 [DEBUG   ] Got command RPT from MCS: ref #327280
2018-10-31 02:10:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327280  77 58422  7827493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:10:27 [DEBUG   ] Got command RPT from MCS: ref #327281
2018-10-31 02:10:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327281  12 58422  7827697 A  ERRORB'
2018-10-31 02:10:40 [DEBUG   ] Got command RPT from MCS: ref #327282
2018-10-31 02:10:40 [DEBUG   ] summary = ERROR
2018-10-31 02:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327282  13 58422  7840021 A  ERRORERROR'
2018-10-31 02:10:40 [DEBUG   ] Got command RPT from MCS: ref #327283
2018-10-31 02:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327283  77 58422  7840022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:10:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:11:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:11:13 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-10-31 02:11:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:11:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:12:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:12:13 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-10-31 02:12:22 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-31 02:12:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 02:13:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 02:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-31 02:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:13:13 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-10-31 02:13:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 02:13:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 02:14:00 [DEBUG   ] Got command TBN from MCS: ref #327303
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-31 02:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   327303   8 58422  8040265 A  ERROR'
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540952041']
2018-10-31 02:14:00 [DEBUG   ] spawn_process: at 2018-10-31 02:14:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540952041']
2018-10-31 02:14:00 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-31 02:14:02 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-31 02:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:14:14 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-10-31 02:14:22 [DEBUG   ] Finished updating ant stats in 0.465 seconds
2018-10-31 02:14:43 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 02:15:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 02:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 02:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:15:14 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-31 02:15:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:15:26 [DEBUG   ] Got command RPT from MCS: ref #327306
2018-10-31 02:15:26 [DEBUG   ] summary = ERROR
2018-10-31 02:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327306  13 58422  8126977 A  ERRORERROR'
2018-10-31 02:15:27 [DEBUG   ] Got command RPT from MCS: ref #327307
2018-10-31 02:15:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327307  77 58422  8127181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:15:27 [DEBUG   ] Got command RPT from MCS: ref #327308
2018-10-31 02:15:27 [DEBUG   ] summary = ERROR
2018-10-31 02:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327308  13 58422  8127373 A  ERRORERROR'
2018-10-31 02:15:27 [DEBUG   ] Got command RPT from MCS: ref #327310
2018-10-31 02:15:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327310  77 58422  8127577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:15:27 [DEBUG   ] Got command RPT from MCS: ref #327312
2018-10-31 02:15:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327312  12 58422  8127781 A  ERRORB'
2018-10-31 02:15:40 [DEBUG   ] Got command RPT from MCS: ref #327316
2018-10-31 02:15:40 [DEBUG   ] summary = ERROR
2018-10-31 02:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327316  13 58422  8140025 A  ERRORERROR'
2018-10-31 02:15:40 [DEBUG   ] Got command RPT from MCS: ref #327317
2018-10-31 02:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327317  77 58422  8140026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:15:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:16:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 02:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:16:14 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-31 02:16:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:16:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:17:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 02:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:17:14 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-31 02:17:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 02:17:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:18:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 02:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:18:14 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-31 02:18:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:18:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 02:19:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-31 02:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:19:14 [WARNING ] (25, 5, 'bot')
2018-10-31 02:19:14 [WARNING ] (25, 5, 'bot')
2018-10-31 02:19:14 [WARNING ] (25, 5, 'bot')
2018-10-31 02:19:14 [WARNING ] (25, 5, 'bot')
2018-10-31 02:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:19:14 [DEBUG   ] Finished updating board flags in 1.684 seconds
2018-10-31 02:19:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 02:19:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:20:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 02:20:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:20:14 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-31 02:20:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 02:20:27 [DEBUG   ] Got command RPT from MCS: ref #327341
2018-10-31 02:20:27 [DEBUG   ] summary = ERROR
2018-10-31 02:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327341  13 58422  8427061 A  ERRORERROR'
2018-10-31 02:20:27 [DEBUG   ] Got command RPT from MCS: ref #327342
2018-10-31 02:20:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327342  77 58422  8427265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:20:27 [DEBUG   ] Got command RPT from MCS: ref #327343
2018-10-31 02:20:27 [DEBUG   ] summary = ERROR
2018-10-31 02:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327343  13 58422  8427469 A  ERRORERROR'
2018-10-31 02:20:27 [DEBUG   ] Got command RPT from MCS: ref #327344
2018-10-31 02:20:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327344  77 58422  8427661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:20:27 [DEBUG   ] Got command RPT from MCS: ref #327345
2018-10-31 02:20:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327345  12 58422  8427865 A  ERRORB'
2018-10-31 02:20:40 [DEBUG   ] Got command RPT from MCS: ref #327346
2018-10-31 02:20:40 [DEBUG   ] summary = ERROR
2018-10-31 02:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327346  13 58422  8440021 A  ERRORERROR'
2018-10-31 02:20:40 [DEBUG   ] Got command RPT from MCS: ref #327347
2018-10-31 02:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327347  77 58422  8440022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:20:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 02:21:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 02:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:21:14 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-10-31 02:21:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 02:21:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:22:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-31 02:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:22:14 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-10-31 02:22:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 02:22:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 02:23:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:23:15 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-10-31 02:23:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:23:43 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-31 02:24:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:24:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:24:15 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-10-31 02:24:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:24:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:25:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:25:15 [DEBUG   ] Finished updating board flags in 2.076 seconds
2018-10-31 02:25:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 02:25:27 [DEBUG   ] Got command RPT from MCS: ref #327373
2018-10-31 02:25:27 [DEBUG   ] summary = ERROR
2018-10-31 02:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327373  13 58422  8727153 A  ERRORERROR'
2018-10-31 02:25:27 [DEBUG   ] Got command RPT from MCS: ref #327374
2018-10-31 02:25:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327374  77 58422  8727345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:25:27 [DEBUG   ] Got command RPT from MCS: ref #327375
2018-10-31 02:25:27 [DEBUG   ] summary = ERROR
2018-10-31 02:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327375  13 58422  8727549 A  ERRORERROR'
2018-10-31 02:25:27 [DEBUG   ] Got command RPT from MCS: ref #327377
2018-10-31 02:25:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327377  77 58422  8727753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:25:27 [DEBUG   ] Got command RPT from MCS: ref #327378
2018-10-31 02:25:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327378  12 58422  8727957 A  ERRORB'
2018-10-31 02:25:40 [DEBUG   ] Got command RPT from MCS: ref #327383
2018-10-31 02:25:40 [DEBUG   ] summary = ERROR
2018-10-31 02:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327383  13 58422  8740017 A  ERRORERROR'
2018-10-31 02:25:40 [DEBUG   ] Got command RPT from MCS: ref #327384
2018-10-31 02:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327384  77 58422  8740018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:25:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:26:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 02:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:26:15 [DEBUG   ] Finished updating board flags in 1.940 seconds
2018-10-31 02:26:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 02:26:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 02:27:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:27:15 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-31 02:27:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:27:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:28:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 02:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:28:15 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-31 02:28:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:28:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 02:29:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:29:15 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-31 02:29:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:29:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:30:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:30:15 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-31 02:30:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:30:27 [DEBUG   ] Got command RPT from MCS: ref #327404
2018-10-31 02:30:27 [DEBUG   ] summary = ERROR
2018-10-31 02:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327404  13 58422  9027237 A  ERRORERROR'
2018-10-31 02:30:27 [DEBUG   ] Got command RPT from MCS: ref #327405
2018-10-31 02:30:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327405  77 58422  9027441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:30:27 [DEBUG   ] Got command RPT from MCS: ref #327406
2018-10-31 02:30:27 [DEBUG   ] summary = ERROR
2018-10-31 02:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327406  13 58422  9027633 A  ERRORERROR'
2018-10-31 02:30:27 [DEBUG   ] Got command RPT from MCS: ref #327407
2018-10-31 02:30:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327407  77 58422  9027837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:30:28 [DEBUG   ] Got command RPT from MCS: ref #327408
2018-10-31 02:30:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327408  12 58422  9028041 A  ERRORB'
2018-10-31 02:30:40 [DEBUG   ] Got command RPT from MCS: ref #327409
2018-10-31 02:30:40 [DEBUG   ] summary = ERROR
2018-10-31 02:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327409  13 58422  9040017 A  ERRORERROR'
2018-10-31 02:30:40 [DEBUG   ] Got command RPT from MCS: ref #327410
2018-10-31 02:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327410  77 58422  9040018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:30:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 02:31:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:31:15 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-31 02:31:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:31:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:32:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:32:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 02:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:32:15 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-31 02:32:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:32:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:33:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:33:16 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-10-31 02:33:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:33:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:34:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:34:16 [DEBUG   ] Finished updating board flags in 2.248 seconds
2018-10-31 02:34:23 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-31 02:34:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 02:35:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 02:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:35:16 [DEBUG   ] Finished updating board flags in 2.132 seconds
2018-10-31 02:35:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:35:27 [DEBUG   ] Got command RPT from MCS: ref #327436
2018-10-31 02:35:27 [DEBUG   ] summary = ERROR
2018-10-31 02:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327436  13 58422  9327325 A  ERRORERROR'
2018-10-31 02:35:27 [DEBUG   ] Got command RPT from MCS: ref #327437
2018-10-31 02:35:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327437  77 58422  9327529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:35:27 [DEBUG   ] Got command RPT from MCS: ref #327438
2018-10-31 02:35:27 [DEBUG   ] summary = ERROR
2018-10-31 02:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327438  13 58422  9327733 A  ERRORERROR'
2018-10-31 02:35:27 [DEBUG   ] Got command RPT from MCS: ref #327440
2018-10-31 02:35:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327440  77 58422  9327937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:35:28 [DEBUG   ] Got command RPT from MCS: ref #327441
2018-10-31 02:35:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327441  12 58422  9328129 A  ERRORB'
2018-10-31 02:35:40 [DEBUG   ] Got command RPT from MCS: ref #327446
2018-10-31 02:35:40 [DEBUG   ] summary = ERROR
2018-10-31 02:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327446  13 58422  9340021 A  ERRORERROR'
2018-10-31 02:35:40 [DEBUG   ] Got command RPT from MCS: ref #327447
2018-10-31 02:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327447  77 58422  9340022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:35:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 02:36:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 02:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:36:16 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-10-31 02:36:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 02:36:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 02:37:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 02:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:37:16 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-10-31 02:37:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 02:37:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:38:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:38:16 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-31 02:38:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:38:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:39:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:39:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:39:16 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-31 02:39:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:39:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 02:40:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 02:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:40:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:40:16 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-10-31 02:40:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:40:27 [DEBUG   ] Got command RPT from MCS: ref #327471
2018-10-31 02:40:27 [DEBUG   ] summary = ERROR
2018-10-31 02:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327471  13 58422  9627413 A  ERRORERROR'
2018-10-31 02:40:27 [DEBUG   ] Got command RPT from MCS: ref #327472
2018-10-31 02:40:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327472  77 58422  9627617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:40:27 [DEBUG   ] Got command RPT from MCS: ref #327473
2018-10-31 02:40:27 [DEBUG   ] summary = ERROR
2018-10-31 02:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327473  13 58422  9627821 A  ERRORERROR'
2018-10-31 02:40:28 [DEBUG   ] Got command RPT from MCS: ref #327474
2018-10-31 02:40:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327474  77 58422  9628013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:40:28 [DEBUG   ] Got command RPT from MCS: ref #327475
2018-10-31 02:40:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327475  12 58422  9628217 A  ERRORB'
2018-10-31 02:40:40 [DEBUG   ] Got command RPT from MCS: ref #327476
2018-10-31 02:40:40 [DEBUG   ] summary = ERROR
2018-10-31 02:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327476  13 58422  9640029 A  ERRORERROR'
2018-10-31 02:40:40 [DEBUG   ] Got command RPT from MCS: ref #327477
2018-10-31 02:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327477  77 58422  9640030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:40:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:41:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 02:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:41:16 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-31 02:41:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 02:41:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:42:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 02:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:42:16 [DEBUG   ] Finished updating board flags in 1.674 seconds
2018-10-31 02:42:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 02:42:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:43:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:43:16 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-31 02:43:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:43:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:44:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:44:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 02:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:44:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:44:16 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-10-31 02:44:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:44:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 02:45:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 02:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:45:16 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-10-31 02:45:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 02:45:27 [DEBUG   ] Got command RPT from MCS: ref #327499
2018-10-31 02:45:27 [DEBUG   ] summary = ERROR
2018-10-31 02:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327499  13 58422  9927497 A  ERRORERROR'
2018-10-31 02:45:27 [DEBUG   ] Got command RPT from MCS: ref #327500
2018-10-31 02:45:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327500  77 58422  9927701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:45:27 [DEBUG   ] Got command RPT from MCS: ref #327501
2018-10-31 02:45:27 [DEBUG   ] summary = ERROR
2018-10-31 02:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327501  13 58422  9927905 A  ERRORERROR'
2018-10-31 02:45:28 [DEBUG   ] Got command RPT from MCS: ref #327503
2018-10-31 02:45:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327503  77 58422  9928097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:45:28 [DEBUG   ] Got command RPT from MCS: ref #327504
2018-10-31 02:45:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327504  12 58422  9928301 A  ERRORB'
2018-10-31 02:45:40 [DEBUG   ] Got command RPT from MCS: ref #327509
2018-10-31 02:45:40 [DEBUG   ] summary = ERROR
2018-10-31 02:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327509  13 58422  9940025 A  ERRORERROR'
2018-10-31 02:45:40 [DEBUG   ] Got command RPT from MCS: ref #327510
2018-10-31 02:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327510  77 58422  9940026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:45:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 02:46:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:46:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:46:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:46:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:46:16 [WARNING ] (13, 1, 'bot')
2018-10-31 02:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:46:16 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-31 02:46:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 02:46:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:47:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 02:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:47:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:47:17 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-10-31 02:47:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 02:47:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 02:48:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 02:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 02:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:48:17 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-10-31 02:48:25 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 02:48:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 02:49:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:49:17 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-31 02:49:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:49:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:50:05 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2018-10-31 02:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:50:17 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-31 02:50:25 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-10-31 02:50:27 [DEBUG   ] Got command RPT from MCS: ref #327534
2018-10-31 02:50:27 [DEBUG   ] summary = ERROR
2018-10-31 02:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327534  13 58422 10227593 A  ERRORERROR'
2018-10-31 02:50:27 [DEBUG   ] Got command RPT from MCS: ref #327535
2018-10-31 02:50:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327535  77 58422 10227785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:50:27 [DEBUG   ] Got command RPT from MCS: ref #327536
2018-10-31 02:50:27 [DEBUG   ] summary = ERROR
2018-10-31 02:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327536  13 58422 10227989 A  ERRORERROR'
2018-10-31 02:50:28 [DEBUG   ] Got command RPT from MCS: ref #327537
2018-10-31 02:50:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327537  77 58422 10228193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:50:28 [DEBUG   ] Got command RPT from MCS: ref #327538
2018-10-31 02:50:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327538  12 58422 10228397 A  ERRORB'
2018-10-31 02:50:40 [DEBUG   ] Got command RPT from MCS: ref #327539
2018-10-31 02:50:40 [DEBUG   ] summary = ERROR
2018-10-31 02:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327539  13 58422 10240025 A  ERRORERROR'
2018-10-31 02:50:40 [DEBUG   ] Got command RPT from MCS: ref #327540
2018-10-31 02:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327540  77 58422 10240026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:50:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:51:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:51:17 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-10-31 02:51:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 02:51:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 02:52:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 02:52:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:52:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:52:17 [DEBUG   ] Finished updating board flags in 1.670 seconds
2018-10-31 02:52:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 02:52:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 02:53:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 02:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:53:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:53:17 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-10-31 02:53:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:53:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 02:54:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 02:54:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:54:17 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-31 02:54:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 02:54:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 02:55:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 02:55:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:55:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:55:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:55:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:55:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:55:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:55:17 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-10-31 02:55:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 02:55:27 [DEBUG   ] Got command RPT from MCS: ref #327566
2018-10-31 02:55:27 [DEBUG   ] summary = ERROR
2018-10-31 02:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327566  13 58422 10527673 A  ERRORERROR'
2018-10-31 02:55:27 [DEBUG   ] Got command RPT from MCS: ref #327567
2018-10-31 02:55:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327567  77 58422 10527877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:55:28 [DEBUG   ] Got command RPT from MCS: ref #327568
2018-10-31 02:55:28 [DEBUG   ] summary = ERROR
2018-10-31 02:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327568  13 58422 10528069 A  ERRORERROR'
2018-10-31 02:55:28 [DEBUG   ] Got command RPT from MCS: ref #327570
2018-10-31 02:55:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327570  77 58422 10528273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:55:28 [DEBUG   ] Got command RPT from MCS: ref #327571
2018-10-31 02:55:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 02:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327571  12 58422 10528477 A  ERRORB'
2018-10-31 02:55:40 [DEBUG   ] Got command RPT from MCS: ref #327576
2018-10-31 02:55:40 [DEBUG   ] summary = ERROR
2018-10-31 02:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327576  13 58422 10540033 A  ERRORERROR'
2018-10-31 02:55:40 [DEBUG   ] Got command RPT from MCS: ref #327577
2018-10-31 02:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 02:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327577  77 58422 10540034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 02:55:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 02:56:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 02:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:56:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:56:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:56:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:56:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:56:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:56:17 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-10-31 02:56:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:56:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 02:57:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 02:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:57:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:57:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:57:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:57:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:57:17 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-10-31 02:57:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:57:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:58:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 02:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 02:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:58:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:58:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:58:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:58:17 [WARNING ] (13, 1, 'bot')
2018-10-31 02:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:58:17 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-10-31 02:58:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:58:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 02:59:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 02:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-31 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-31 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-31 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-31 02:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 02:59:18 [DEBUG   ] Finished updating board flags in 2.251 seconds
2018-10-31 02:59:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 02:59:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:00:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 03:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:00:18 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-31 03:00:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 03:00:27 [DEBUG   ] Got command RPT from MCS: ref #327597
2018-10-31 03:00:27 [DEBUG   ] summary = ERROR
2018-10-31 03:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327597  13 58422 10827753 A  ERRORERROR'
2018-10-31 03:00:27 [DEBUG   ] Got command RPT from MCS: ref #327598
2018-10-31 03:00:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327598  77 58422 10827957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:00:28 [DEBUG   ] Got command RPT from MCS: ref #327599
2018-10-31 03:00:28 [DEBUG   ] summary = ERROR
2018-10-31 03:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327599  13 58422 10828161 A  ERRORERROR'
2018-10-31 03:00:28 [DEBUG   ] Got command RPT from MCS: ref #327600
2018-10-31 03:00:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327600  77 58422 10828365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:00:28 [DEBUG   ] Got command RPT from MCS: ref #327601
2018-10-31 03:00:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327601  12 58422 10828557 A  ERRORB'
2018-10-31 03:00:40 [DEBUG   ] Got command RPT from MCS: ref #327602
2018-10-31 03:00:40 [DEBUG   ] summary = ERROR
2018-10-31 03:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327602  13 58422 10840029 A  ERRORERROR'
2018-10-31 03:00:40 [DEBUG   ] Got command RPT from MCS: ref #327603
2018-10-31 03:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327603  77 58422 10840030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:00:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:01:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:01:18 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-31 03:01:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:01:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:02:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:02:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 03:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:02:18 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-31 03:02:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 03:02:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:03:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:03:18 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-31 03:03:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:03:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:04:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:04:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:04:18 [DEBUG   ] Finished updating board flags in 1.921 seconds
2018-10-31 03:04:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:04:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:05:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:05:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:05:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:05:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:05:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:05:18 [DEBUG   ] Finished updating board flags in 1.669 seconds
2018-10-31 03:05:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 03:05:27 [DEBUG   ] Got command RPT from MCS: ref #327629
2018-10-31 03:05:27 [DEBUG   ] summary = ERROR
2018-10-31 03:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327629  13 58422 11127837 A  ERRORERROR'
2018-10-31 03:05:28 [DEBUG   ] Got command RPT from MCS: ref #327630
2018-10-31 03:05:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327630  77 58422 11128041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:05:28 [DEBUG   ] Got command RPT from MCS: ref #327631
2018-10-31 03:05:28 [DEBUG   ] summary = ERROR
2018-10-31 03:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327631  13 58422 11128245 A  ERRORERROR'
2018-10-31 03:05:28 [DEBUG   ] Got command RPT from MCS: ref #327633
2018-10-31 03:05:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327633  77 58422 11128449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:05:28 [DEBUG   ] Got command RPT from MCS: ref #327634
2018-10-31 03:05:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327634  12 58422 11128641 A  ERRORB'
2018-10-31 03:05:40 [DEBUG   ] Got command RPT from MCS: ref #327639
2018-10-31 03:05:40 [DEBUG   ] summary = ERROR
2018-10-31 03:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327639  13 58422 11140029 A  ERRORERROR'
2018-10-31 03:05:40 [DEBUG   ] Got command RPT from MCS: ref #327640
2018-10-31 03:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327640  77 58422 11140030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:05:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:06:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 03:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:06:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:06:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:06:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:06:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:06:18 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-31 03:06:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:06:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:07:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:07:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:07:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:07:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:07:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:07:18 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-31 03:07:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:07:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:08:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:08:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:08:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:08:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:08:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:08:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:08:18 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-10-31 03:08:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:08:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:09:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:09:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:09:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:09:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:09:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:09:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:09:18 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-31 03:09:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:09:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:10:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:10:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:10:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:10:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:10:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:10:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:10:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:10:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:10:18 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-31 03:10:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:10:27 [DEBUG   ] Got command RPT from MCS: ref #327664
2018-10-31 03:10:27 [DEBUG   ] summary = ERROR
2018-10-31 03:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327664  13 58422 11427937 A  ERRORERROR'
2018-10-31 03:10:28 [DEBUG   ] Got command RPT from MCS: ref #327665
2018-10-31 03:10:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327665  77 58422 11428129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:10:28 [DEBUG   ] Got command RPT from MCS: ref #327666
2018-10-31 03:10:28 [DEBUG   ] summary = ERROR
2018-10-31 03:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327666  13 58422 11428333 A  ERRORERROR'
2018-10-31 03:10:28 [DEBUG   ] Got command RPT from MCS: ref #327667
2018-10-31 03:10:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327667  77 58422 11428537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:10:28 [DEBUG   ] Got command RPT from MCS: ref #327668
2018-10-31 03:10:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327668  12 58422 11428729 A  ERRORB'
2018-10-31 03:10:40 [DEBUG   ] Got command RPT from MCS: ref #327669
2018-10-31 03:10:40 [DEBUG   ] summary = ERROR
2018-10-31 03:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327669  13 58422 11440033 A  ERRORERROR'
2018-10-31 03:10:40 [DEBUG   ] Got command RPT from MCS: ref #327670
2018-10-31 03:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327670  77 58422 11440034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:10:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:11:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:11:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:11:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:11:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:11:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:11:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:11:18 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-10-31 03:11:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:11:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:12:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:12:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:12:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:12:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:12:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:12:18 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-10-31 03:12:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:12:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:13:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:13:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:13:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:13:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:13:18 [WARNING ] (13, 1, 'bot')
2018-10-31 03:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:13:18 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-31 03:13:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:13:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:14:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:14:19 [DEBUG   ] Finished updating board flags in 1.638 seconds
2018-10-31 03:14:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:14:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 03:15:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:15:19 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-10-31 03:15:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 03:15:28 [DEBUG   ] Got command RPT from MCS: ref #327692
2018-10-31 03:15:28 [DEBUG   ] summary = ERROR
2018-10-31 03:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327692  13 58422 11728013 A  ERRORERROR'
2018-10-31 03:15:28 [DEBUG   ] Got command RPT from MCS: ref #327693
2018-10-31 03:15:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327693  77 58422 11728217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:15:28 [DEBUG   ] Got command RPT from MCS: ref #327694
2018-10-31 03:15:28 [DEBUG   ] summary = ERROR
2018-10-31 03:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327694  13 58422 11728421 A  ERRORERROR'
2018-10-31 03:15:28 [DEBUG   ] Got command RPT from MCS: ref #327696
2018-10-31 03:15:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327696  77 58422 11728625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:15:28 [DEBUG   ] Got command RPT from MCS: ref #327698
2018-10-31 03:15:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327698  12 58422 11728817 A  ERRORB'
2018-10-31 03:15:40 [DEBUG   ] Got command RPT from MCS: ref #327702
2018-10-31 03:15:40 [DEBUG   ] summary = ERROR
2018-10-31 03:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327702  13 58422 11740029 A  ERRORERROR'
2018-10-31 03:15:40 [DEBUG   ] Got command RPT from MCS: ref #327703
2018-10-31 03:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327703  77 58422 11740030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:15:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:16:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:16:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:16:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:16:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:16:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:16:19 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-31 03:16:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:16:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:17:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:17:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:17:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:17:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:17:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:17:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:17:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:17:19 [DEBUG   ] Finished updating board flags in 2.320 seconds
2018-10-31 03:17:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:17:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:18:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:18:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:18:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:18:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:18:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:18:19 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-31 03:18:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:18:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:19:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:19:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:19:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:19:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:19:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:19:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:19:19 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-31 03:19:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:19:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:20:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 03:20:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:20:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:20:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:20:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:20:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:20:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:20:19 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-31 03:20:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 03:20:28 [DEBUG   ] Got command RPT from MCS: ref #327727
2018-10-31 03:20:28 [DEBUG   ] summary = ERROR
2018-10-31 03:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327727  13 58422 12028109 A  ERRORERROR'
2018-10-31 03:20:28 [DEBUG   ] Got command RPT from MCS: ref #327728
2018-10-31 03:20:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327728  77 58422 12028313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:20:28 [DEBUG   ] Got command RPT from MCS: ref #327729
2018-10-31 03:20:28 [DEBUG   ] summary = ERROR
2018-10-31 03:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327729  13 58422 12028517 A  ERRORERROR'
2018-10-31 03:20:28 [DEBUG   ] Got command RPT from MCS: ref #327730
2018-10-31 03:20:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327730  77 58422 12028709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:20:28 [DEBUG   ] Got command RPT from MCS: ref #327731
2018-10-31 03:20:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327731  12 58422 12028913 A  ERRORB'
2018-10-31 03:20:40 [DEBUG   ] Got command RPT from MCS: ref #327732
2018-10-31 03:20:40 [DEBUG   ] summary = ERROR
2018-10-31 03:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327732  13 58422 12040037 A  ERRORERROR'
2018-10-31 03:20:40 [DEBUG   ] Got command RPT from MCS: ref #327733
2018-10-31 03:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327733  77 58422 12040038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:20:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:21:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:21:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:21:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:21:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:21:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:21:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:21:19 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-31 03:21:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 03:21:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 03:22:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 03:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:22:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:22:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:22:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:22:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:22:19 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-10-31 03:22:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:22:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 03:23:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-31 03:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:23:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:23:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:23:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:23:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:23:19 [DEBUG   ] Finished updating board flags in 1.680 seconds
2018-10-31 03:23:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-31 03:23:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 03:24:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 03:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:24:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:24:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:24:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:24:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:24:19 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-10-31 03:24:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 03:24:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:25:07 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-31 03:25:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:25:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:25:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:25:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:25:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:25:19 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-31 03:25:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:25:28 [DEBUG   ] Got command RPT from MCS: ref #327759
2018-10-31 03:25:28 [DEBUG   ] summary = ERROR
2018-10-31 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327759  13 58422 12328193 A  ERRORERROR'
2018-10-31 03:25:28 [DEBUG   ] Got command RPT from MCS: ref #327760
2018-10-31 03:25:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327760  77 58422 12328397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:25:28 [DEBUG   ] Got command RPT from MCS: ref #327761
2018-10-31 03:25:28 [DEBUG   ] summary = ERROR
2018-10-31 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327761  13 58422 12328601 A  ERRORERROR'
2018-10-31 03:25:28 [DEBUG   ] Got command RPT from MCS: ref #327763
2018-10-31 03:25:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327763  77 58422 12328793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:25:28 [DEBUG   ] Got command RPT from MCS: ref #327764
2018-10-31 03:25:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327764  12 58422 12328997 A  ERRORB'
2018-10-31 03:25:40 [DEBUG   ] Got command RPT from MCS: ref #327769
2018-10-31 03:25:40 [DEBUG   ] summary = ERROR
2018-10-31 03:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327769  13 58422 12340037 A  ERRORERROR'
2018-10-31 03:25:40 [DEBUG   ] Got command RPT from MCS: ref #327770
2018-10-31 03:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327770  77 58422 12340038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:25:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:26:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:26:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:26:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:26:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:26:19 [WARNING ] (13, 1, 'bot')
2018-10-31 03:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:26:19 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-31 03:26:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:26:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 03:27:07 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-31 03:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:27:20 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-31 03:27:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:27:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:28:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 03:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:28:20 [DEBUG   ] Finished updating board flags in 1.956 seconds
2018-10-31 03:28:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:28:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:29:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:29:20 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-31 03:29:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:29:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:30:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:30:20 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-10-31 03:30:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:30:28 [DEBUG   ] Got command RPT from MCS: ref #327790
2018-10-31 03:30:28 [DEBUG   ] summary = ERROR
2018-10-31 03:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327790  13 58422 12628277 A  ERRORERROR'
2018-10-31 03:30:28 [DEBUG   ] Got command RPT from MCS: ref #327791
2018-10-31 03:30:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327791  77 58422 12628481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:30:28 [DEBUG   ] Got command RPT from MCS: ref #327792
2018-10-31 03:30:28 [DEBUG   ] summary = ERROR
2018-10-31 03:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327792  13 58422 12628685 A  ERRORERROR'
2018-10-31 03:30:28 [DEBUG   ] Got command RPT from MCS: ref #327793
2018-10-31 03:30:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327793  77 58422 12628889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:30:29 [DEBUG   ] Got command RPT from MCS: ref #327794
2018-10-31 03:30:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327794  12 58422 12629081 A  ERRORB'
2018-10-31 03:30:40 [DEBUG   ] Got command RPT from MCS: ref #327795
2018-10-31 03:30:40 [DEBUG   ] summary = ERROR
2018-10-31 03:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327795  13 58422 12640033 A  ERRORERROR'
2018-10-31 03:30:40 [DEBUG   ] Got command RPT from MCS: ref #327796
2018-10-31 03:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327796  77 58422 12640034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:30:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 03:31:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:31:20 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-10-31 03:31:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 03:31:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:32:00 [DEBUG   ] Got command TBN from MCS: ref #327816
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-31 03:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   327816   8 58422 12720285 A  ERROR'
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540956721']
2018-10-31 03:32:00 [DEBUG   ] spawn_process: at 2018-10-31 03:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540956721']
2018-10-31 03:32:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-10-31 03:32:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:32:20 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-31 03:32:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 03:32:47 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-31 03:33:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 03:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-31 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:33:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:33:20 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-10-31 03:33:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 03:33:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 03:34:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 03:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:34:20 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-10-31 03:34:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 03:34:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 03:35:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 03:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:35:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:35:20 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-31 03:35:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:35:28 [DEBUG   ] Got command RPT from MCS: ref #327823
2018-10-31 03:35:28 [DEBUG   ] summary = ERROR
2018-10-31 03:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327823  13 58422 12928365 A  ERRORERROR'
2018-10-31 03:35:28 [DEBUG   ] Got command RPT from MCS: ref #327824
2018-10-31 03:35:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327824  77 58422 12928569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:35:28 [DEBUG   ] Got command RPT from MCS: ref #327825
2018-10-31 03:35:28 [DEBUG   ] summary = ERROR
2018-10-31 03:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327825  13 58422 12928773 A  ERRORERROR'
2018-10-31 03:35:28 [DEBUG   ] Got command RPT from MCS: ref #327827
2018-10-31 03:35:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327827  77 58422 12928977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:35:29 [DEBUG   ] Got command RPT from MCS: ref #327829
2018-10-31 03:35:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327829  12 58422 12929169 A  ERRORB'
2018-10-31 03:35:40 [DEBUG   ] Got command RPT from MCS: ref #327833
2018-10-31 03:35:40 [DEBUG   ] summary = ERROR
2018-10-31 03:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327833  13 58422 12940041 A  ERRORERROR'
2018-10-31 03:35:40 [DEBUG   ] Got command RPT from MCS: ref #327834
2018-10-31 03:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327834  77 58422 12940042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:35:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:36:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 03:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:36:20 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-31 03:36:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:36:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 03:37:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 03:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-31 03:37:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:37:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:37:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:37:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:37:20 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-31 03:37:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 03:37:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 03:38:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:38:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:38:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:38:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:38:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:38:20 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-31 03:38:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:38:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 03:39:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 03:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:39:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:39:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:39:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:39:20 [WARNING ] (13, 1, 'bot')
2018-10-31 03:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:39:20 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-31 03:39:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 03:39:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 03:40:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 03:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:40:21 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-10-31 03:40:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 03:40:28 [DEBUG   ] Got command RPT from MCS: ref #327858
2018-10-31 03:40:28 [DEBUG   ] summary = ERROR
2018-10-31 03:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327858  13 58422 13228457 A  ERRORERROR'
2018-10-31 03:40:28 [DEBUG   ] Got command RPT from MCS: ref #327859
2018-10-31 03:40:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327859  77 58422 13228649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:40:28 [DEBUG   ] Got command RPT from MCS: ref #327860
2018-10-31 03:40:28 [DEBUG   ] summary = ERROR
2018-10-31 03:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327860  13 58422 13228853 A  ERRORERROR'
2018-10-31 03:40:29 [DEBUG   ] Got command RPT from MCS: ref #327861
2018-10-31 03:40:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327861  77 58422 13229057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:40:29 [DEBUG   ] Got command RPT from MCS: ref #327862
2018-10-31 03:40:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327862  12 58422 13229261 A  ERRORB'
2018-10-31 03:40:40 [DEBUG   ] Got command RPT from MCS: ref #327863
2018-10-31 03:40:40 [DEBUG   ] summary = ERROR
2018-10-31 03:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327863  13 58422 13240037 A  ERRORERROR'
2018-10-31 03:40:40 [DEBUG   ] Got command RPT from MCS: ref #327864
2018-10-31 03:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327864  77 58422 13240038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:40:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 03:41:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 03:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:41:21 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-31 03:41:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 03:41:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 03:42:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 03:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:42:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 03:42:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:42:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:42:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:42:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:42:21 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-10-31 03:42:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 03:42:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:43:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:43:21 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-31 03:43:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 03:43:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 03:44:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:44:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 03:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:44:21 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-31 03:44:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:44:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:45:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 03:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:45:21 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-31 03:45:28 [DEBUG   ] Got command RPT from MCS: ref #327886
2018-10-31 03:45:28 [DEBUG   ] summary = ERROR
2018-10-31 03:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327886  13 58422 13528536 A  ERRORERROR'
2018-10-31 03:45:28 [DEBUG   ] Got command RPT from MCS: ref #327887
2018-10-31 03:45:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327887  77 58422 13528737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:45:28 [DEBUG   ] Got command RPT from MCS: ref #327888
2018-10-31 03:45:28 [DEBUG   ] summary = ERROR
2018-10-31 03:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327888  13 58422 13528941 A  ERRORERROR'
2018-10-31 03:45:29 [DEBUG   ] Got command RPT from MCS: ref #327889
2018-10-31 03:45:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327889  77 58422 13529145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:45:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:45:29 [DEBUG   ] Got command RPT from MCS: ref #327891
2018-10-31 03:45:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 03:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327891  12 58422 13529338 A  ERRORB'
2018-10-31 03:45:40 [DEBUG   ] Got command RPT from MCS: ref #327896
2018-10-31 03:45:40 [DEBUG   ] summary = ERROR
2018-10-31 03:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327896  13 58422 13540041 A  ERRORERROR'
2018-10-31 03:45:40 [DEBUG   ] Got command RPT from MCS: ref #327897
2018-10-31 03:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 03:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327897  77 58422 13540042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 03:45:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:46:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 03:46:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-31 03:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:46:21 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-10-31 03:46:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 03:46:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:47:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:47:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:47:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:47:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:47:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:47:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:47:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:47:22 [DEBUG   ] Finished updating board flags in 2.301 seconds
2018-10-31 03:47:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:47:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 03:48:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 03:48:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-31 03:48:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 03:48:22 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-10-31 03:48:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 03:48:48 [DEBUG   ] Got command RPT from MCS: ref #327921
2018-10-31 03:48:48 [DEBUG   ] summary = ERROR
2018-10-31 03:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327921  13 58422 13728953 A  ERRORERROR'
2018-10-31 03:48:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 03:48:49 [DEBUG   ] Got command SHT from MCS: ref #327923
2018-10-31 03:48:49 [DEBUG   ] Stopping antenna statistics
2018-10-31 03:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT   327923   8 58422 13729365 ASHUTDWN'
2018-10-31 03:48:51 [DEBUG   ] Stopping beam statistics
2018-10-31 03:48:51 [DEBUG   ] Stopping monitoring flags
2018-10-31 03:48:51 [DEBUG   ] Stopping BAM updater
2018-10-31 03:48:51 [DEBUG   ] Stopping DRX time setter
2018-10-31 03:48:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:48:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:02 [DEBUG   ] run_process: at 2018-10-31 03:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:03 [DEBUG   ] run_process: at 2018-10-31 03:49:03 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:04 [DEBUG   ] run_process: at 2018-10-31 03:49:04 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:05 [DEBUG   ] run_process: at 2018-10-31 03:49:05 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:05 [DEBUG   ] run_process: at 2018-10-31 03:49:05 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:05 [DEBUG   ] run_process: at 2018-10-31 03:49:05 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2018-10-31 03:49:05 [INFO    ] Finished the SHT process in 16.095 s
2018-10-31 03:50:28 [DEBUG   ] Got command RPT from MCS: ref #327935
2018-10-31 03:50:28 [DEBUG   ] summary = SHUTDWN
2018-10-31 03:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327935  15 58422 13828621 ASHUTDWNSHUTDWN'
2018-10-31 03:50:40 [DEBUG   ] Got command RPT from MCS: ref #327936
2018-10-31 03:50:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 03:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327936  15 58422 13840045 ASHUTDWNSHUTDWN'
2018-10-31 03:50:40 [DEBUG   ] Got command RPT from MCS: ref #327937
2018-10-31 03:50:40 [DEBUG   ] info = System has been shut down
2018-10-31 03:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327937  33 58422 13840046 ASHUTDWNSystem has been shut down'
2018-10-31 03:55:28 [DEBUG   ] Got command RPT from MCS: ref #327983
2018-10-31 03:55:28 [DEBUG   ] summary = SHUTDWN
2018-10-31 03:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327983  15 58422 14128701 ASHUTDWNSHUTDWN'
2018-10-31 03:55:40 [DEBUG   ] Got command RPT from MCS: ref #327989
2018-10-31 03:55:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 03:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327989  15 58422 14140189 ASHUTDWNSHUTDWN'
2018-10-31 03:55:40 [DEBUG   ] Got command RPT from MCS: ref #327990
2018-10-31 03:55:40 [DEBUG   ] info = System has been shut down
2018-10-31 03:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   327990  33 58422 14140190 ASHUTDWNSystem has been shut down'
2018-10-31 04:00:28 [DEBUG   ] Got command RPT from MCS: ref #328020
2018-10-31 04:00:28 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328020  15 58422 14428793 ASHUTDWNSHUTDWN'
2018-10-31 04:00:40 [DEBUG   ] Got command RPT from MCS: ref #328021
2018-10-31 04:00:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328021  15 58422 14440051 ASHUTDWNSHUTDWN'
2018-10-31 04:00:40 [DEBUG   ] Got command RPT from MCS: ref #328022
2018-10-31 04:00:40 [DEBUG   ] info = System has been shut down
2018-10-31 04:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328022  33 58422 14440052 ASHUTDWNSystem has been shut down'
2018-10-31 04:05:28 [DEBUG   ] Got command RPT from MCS: ref #328068
2018-10-31 04:05:28 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328068  15 58422 14728866 ASHUTDWNSHUTDWN'
2018-10-31 04:05:40 [DEBUG   ] Got command RPT from MCS: ref #328074
2018-10-31 04:05:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328074  15 58422 14740163 ASHUTDWNSHUTDWN'
2018-10-31 04:05:40 [DEBUG   ] Got command RPT from MCS: ref #328075
2018-10-31 04:05:40 [DEBUG   ] info = System has been shut down
2018-10-31 04:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328075  33 58422 14740163 ASHUTDWNSystem has been shut down'
2018-10-31 04:10:28 [DEBUG   ] Got command RPT from MCS: ref #328120
2018-10-31 04:10:28 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328120  15 58422 15028957 ASHUTDWNSHUTDWN'
2018-10-31 04:10:40 [DEBUG   ] Got command RPT from MCS: ref #328121
2018-10-31 04:10:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328121  15 58422 15040046 ASHUTDWNSHUTDWN'
2018-10-31 04:10:40 [DEBUG   ] Got command RPT from MCS: ref #328122
2018-10-31 04:10:40 [DEBUG   ] info = System has been shut down
2018-10-31 04:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328122  33 58422 15040046 ASHUTDWNSystem has been shut down'
2018-10-31 04:15:29 [DEBUG   ] Got command RPT from MCS: ref #328155
2018-10-31 04:15:29 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328155  15 58422 15329034 ASHUTDWNSHUTDWN'
2018-10-31 04:15:40 [DEBUG   ] Got command RPT from MCS: ref #328161
2018-10-31 04:15:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328161  15 58422 15340237 ASHUTDWNSHUTDWN'
2018-10-31 04:15:40 [DEBUG   ] Got command RPT from MCS: ref #328162
2018-10-31 04:15:40 [DEBUG   ] info = System has been shut down
2018-10-31 04:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328162  33 58422 15340237 ASHUTDWNSystem has been shut down'
2018-10-31 04:20:29 [DEBUG   ] Got command RPT from MCS: ref #328208
2018-10-31 04:20:29 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328208  15 58422 15629118 ASHUTDWNSHUTDWN'
2018-10-31 04:20:40 [DEBUG   ] Got command RPT from MCS: ref #328209
2018-10-31 04:20:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328209  15 58422 15640248 ASHUTDWNSHUTDWN'
2018-10-31 04:20:40 [DEBUG   ] Got command RPT from MCS: ref #328210
2018-10-31 04:20:40 [DEBUG   ] info = System has been shut down
2018-10-31 04:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328210  33 58422 15640249 ASHUTDWNSystem has been shut down'
2018-10-31 04:25:29 [DEBUG   ] Got command RPT from MCS: ref #328258
2018-10-31 04:25:29 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328258  15 58422 15929205 ASHUTDWNSHUTDWN'
2018-10-31 04:25:40 [DEBUG   ] Got command RPT from MCS: ref #328264
2018-10-31 04:25:40 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328264  15 58422 15940185 ASHUTDWNSHUTDWN'
2018-10-31 04:25:40 [DEBUG   ] Got command RPT from MCS: ref #328265
2018-10-31 04:25:40 [DEBUG   ] info = System has been shut down
2018-10-31 04:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328265  33 58422 15940186 ASHUTDWNSystem has been shut down'
2018-10-31 04:28:00 [DEBUG   ] Got command RPT from MCS: ref #328286
2018-10-31 04:28:00 [DEBUG   ] summary = SHUTDWN
2018-10-31 04:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328286  15 58422 16080897 ASHUTDWNSHUTDWN'
2018-10-31 04:28:00 [DEBUG   ] Got command RPT from MCS: ref #328287
2018-10-31 04:28:00 [DEBUG   ] info = System has been shut down
2018-10-31 04:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328287  33 58422 16080898 ASHUTDWNSystem has been shut down'
2018-10-31 04:28:05 [DEBUG   ] Got command INI from MCS: ref #328288
2018-10-31 04:28:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-31 04:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   328288   8 58422 16085906 ABOOTING'
2018-10-31 04:28:25 [INFO    ] -------------------
2018-10-31 04:28:25 [INFO    ]  LWA board status
2018-10-31 04:28:25 [INFO    ] -------------------
2018-10-31 04:28:25 [INFO    ] DP 1: 2 lwa27
2018-10-31 04:28:25 [INFO    ] DP 1: 3 lwa24
2018-10-31 04:28:25 [INFO    ] DP 1: 4 lwa23
2018-10-31 04:28:25 [INFO    ] DP 1: 5 lwa18
2018-10-31 04:28:25 [INFO    ] DP 1: 6 lwa10
2018-10-31 04:28:25 [INFO    ] DP 1: 7 lwa32
2018-10-31 04:28:25 [INFO    ] DP 1: 8 lwa11
2018-10-31 04:28:25 [INFO    ] DP 1: 9 lwa30
2018-10-31 04:28:25 [INFO    ] DP 1: 10 lwa12
2018-10-31 04:28:25 [INFO    ] DP 1: 11 lwa8
2018-10-31 04:28:25 [INFO    ] DP 1: 12 lwa13
2018-10-31 04:28:25 [INFO    ] DP 1: 13 lwa26
2018-10-31 04:28:25 [INFO    ] DP 1: 14 lwa14
2018-10-31 04:28:25 [INFO    ] DP 1: 16 lwa22
2018-10-31 04:28:25 [INFO    ] DP 1: 17 lwa20
2018-10-31 04:28:25 [INFO    ] DP 1: 18 lwa1
2018-10-31 04:28:25 [INFO    ] DP 1: 19 lwa5
2018-10-31 04:28:25 [INFO    ] DP 1: 20 lwa25
2018-10-31 04:28:25 [INFO    ] DP 1: 21 lwa35
2018-10-31 04:28:25 [INFO    ] DP 1: 22 lwa19
2018-10-31 04:28:25 [INFO    ] DP 1: 23 lwa21
2018-10-31 04:28:25 [INFO    ] DP 1: 24 lwa6
2018-10-31 04:28:25 [INFO    ] DP 1: 25 lwa7
2018-10-31 04:28:25 [INFO    ] DP 1: 26 lwa33
2018-10-31 04:28:25 [INFO    ] DP 1: 27 lwa15
2018-10-31 04:28:25 [INFO    ] DP 1: 28 lwa28
2018-10-31 04:28:25 [INFO    ] DP 2: 1 lwa16
2018-10-31 04:28:25 [INFO    ] DP 2: 15 lwa34
2018-10-31 04:28:25 [INFO    ] Total of 28 boards
2018-10-31 04:28:25 [INFO    ] Total of 260 stands
2018-10-31 04:28:25 [INFO    ] -------------------
2018-10-31 04:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28156
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28157
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28158
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28159
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28160
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28161
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28162
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28163
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28164
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28165
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28166
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28167
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28168
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28169
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28170
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28171
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28172
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28173
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28174
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28175
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28176
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28177
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28178
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28179
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28180
2018-10-31 04:28:31 [DEBUG   ] 2018-10-31 04:28:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28181
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28156 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28157 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28158 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28159 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28160 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28161 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28162 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28163 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28164 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28165 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28166 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28167 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28168 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28169 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28170 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28171 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28172 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28173 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28174 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28175 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28176 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28177 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28178 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28179 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28180 exited with status 0
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28181 exited with status 0
2018-10-31 04:28:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] spawn_process: at 2018-10-31 04:28:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28208
2018-10-31 04:28:44 [DEBUG   ] 2018-10-31 04:28:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28209
2018-10-31 04:28:49 [DEBUG   ] 2018-10-31 04:28:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28208 exited with status 0
2018-10-31 04:28:49 [DEBUG   ] 2018-10-31 04:28:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28209 exited with status 0
2018-10-31 04:28:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-31 04:28:49 [DEBUG   ] spawn_process: at 2018-10-31 04:28:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-31 04:28:49 [DEBUG   ] spawn_process: at 2018-10-31 04:28:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-31 04:28:49 [INFO    ] Setting Beam 1 xbars
2018-10-31 04:28:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-31 04:28:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-31 04:28:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-31 04:28:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-31 04:28:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-31 04:28:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-31 04:28:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-31 04:28:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-31 04:28:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-31 04:28:55 [INFO    ] Setting Beam 2 xbars
2018-10-31 04:28:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-31 04:28:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-31 04:28:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-31 04:28:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-31 04:28:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-31 04:28:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-31 04:29:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-31 04:29:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-31 04:29:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-31 04:29:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-31 04:29:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-31 04:29:00 [INFO    ] Setting Beam 3 xbars
2018-10-31 04:29:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-31 04:29:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-31 04:29:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-31 04:29:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-31 04:29:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-31 04:29:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-31 04:29:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-31 04:29:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-31 04:29:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-31 04:29:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-31 04:29:05 [INFO    ] Setting Beam 4 xbars
2018-10-31 04:29:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-31 04:29:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-31 04:29:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-31 04:29:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-31 04:29:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-31 04:29:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-31 04:29:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-31 04:29:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-31 04:29:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-31 04:29:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-31 04:29:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-31 04:29:11 [INFO    ] All xbars set
2018-10-31 04:29:11 [INFO    ] Setting adder chain routing for all beams
2018-10-31 04:29:16 [INFO    ] Setting beam ids
2018-10-31 04:29:26 [INFO    ] Starting beam delay calibration
2018-10-31 04:29:38 [INFO    ] Beam 1 latency is 5730
2018-10-31 04:29:38 [INFO    ] Beam 2 latency is 5778
2018-10-31 04:29:38 [INFO    ] Beam 3 latency is 5762
2018-10-31 04:29:38 [INFO    ] Beam 4 latency is 5719
2018-10-31 04:29:38 [INFO    ] Stop calibration
2018-10-31 04:29:46 [INFO    ] Beam delay calibration successful
2018-10-31 04:29:46 [INFO    ] Calibration passed
2018-10-31 04:29:46 [DEBUG   ] spawn_process: at 2018-10-31 04:29:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-31 04:29:46 [DEBUG   ] spawn_process: at 2018-10-31 04:29:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-31 04:29:46 [DEBUG   ] spawn_process: at 2018-10-31 04:29:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-31 04:29:46 [DEBUG   ] spawn_process: at 2018-10-31 04:29:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-31 04:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-31 04:29:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-31 04:29:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 265 ms (1540960187.266 s) with PID 29785 and time 1540960188
2018-10-31 04:29:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-10-31 04:29:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 353 ms (1540960187.355 s) with PID 29788 and time 1540960188
2018-10-31 04:29:48 [DEBUG   ] Finished updating ant stats in 0.893 seconds
2018-10-31 04:29:48 [INFO    ] Started antennas statistics background thread
2018-10-31 04:29:48 [INFO    ] Started board flags background thread
2018-10-31 04:29:48 [INFO    ] Started BAM background thread
2018-10-31 04:29:48 [INFO    ] Finished the INI process (ref. #328288) in 102.572 s
2018-10-31 04:29:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:29:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:29:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:29:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:29:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:29:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:29:49 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-10-31 04:30:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 04:30:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 04:30:29 [DEBUG   ] Got command RPT from MCS: ref #328294
2018-10-31 04:30:29 [DEBUG   ] summary = ERROR
2018-10-31 04:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328294  13 58422 16229289 A  ERRORERROR'
2018-10-31 04:30:29 [DEBUG   ] Got command RPT from MCS: ref #328295
2018-10-31 04:30:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328295  77 58422 16229493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:30:29 [DEBUG   ] Got command RPT from MCS: ref #328296
2018-10-31 04:30:29 [DEBUG   ] summary = ERROR
2018-10-31 04:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328296  13 58422 16229685 A  ERRORERROR'
2018-10-31 04:30:29 [DEBUG   ] Got command RPT from MCS: ref #328297
2018-10-31 04:30:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328297  77 58422 16229889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:30:30 [DEBUG   ] Got command RPT from MCS: ref #328298
2018-10-31 04:30:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 04:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328298  12 58422 16230093 A  ERRORBr'
2018-10-31 04:30:40 [DEBUG   ] Got command RPT from MCS: ref #328299
2018-10-31 04:30:40 [DEBUG   ] summary = ERROR
2018-10-31 04:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328299  13 58422 16240045 A  ERRORERROR'
2018-10-31 04:30:40 [DEBUG   ] Got command RPT from MCS: ref #328300
2018-10-31 04:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328300  77 58422 16240046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:30:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:30:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:30:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:30:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:30:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:30:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:30:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:30:49 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-10-31 04:31:05 [DEBUG   ] Got command RPT from MCS: ref #328324
2018-10-31 04:31:05 [DEBUG   ] summary = ERROR
2018-10-31 04:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328324  13 58422 16265893 A  ERRORERROR'
2018-10-31 04:31:05 [DEBUG   ] Got command RPT from MCS: ref #328325
2018-10-31 04:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328325  77 58422 16265894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:31:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:31:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:31:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:31:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:31:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:31:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:31:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:31:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:31:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:31:50 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-10-31 04:32:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:32:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:32:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:32:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:32:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:32:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:32:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:32:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:32:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:32:49 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-10-31 04:33:08 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-31 04:33:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 04:33:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 04:33:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:33:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:33:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:33:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:33:49 [WARNING ] (13, 1, 'bot')
2018-10-31 04:33:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:33:49 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-10-31 04:34:08 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-10-31 04:34:29 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-31 04:34:49 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2018-10-31 04:34:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:34:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:34:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:34:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:34:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:34:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:34:50 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-10-31 04:35:09 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2018-10-31 04:35:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 04:35:29 [DEBUG   ] Got command RPT from MCS: ref #328375
2018-10-31 04:35:29 [DEBUG   ] summary = ERROR
2018-10-31 04:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328375  13 58422 16529373 A  ERRORERROR'
2018-10-31 04:35:29 [DEBUG   ] Got command RPT from MCS: ref #328376
2018-10-31 04:35:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328376  77 58422 16529577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:35:29 [DEBUG   ] Got command RPT from MCS: ref #328377
2018-10-31 04:35:29 [DEBUG   ] summary = ERROR
2018-10-31 04:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328377  13 58422 16529781 A  ERRORERROR'
2018-10-31 04:35:29 [DEBUG   ] Got command RPT from MCS: ref #328379
2018-10-31 04:35:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328379  77 58422 16529973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:35:30 [DEBUG   ] Got command RPT from MCS: ref #328380
2018-10-31 04:35:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 04:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328380  12 58422 16530177 A  ERRORB'
2018-10-31 04:35:40 [DEBUG   ] Got command RPT from MCS: ref #328385
2018-10-31 04:35:40 [DEBUG   ] summary = ERROR
2018-10-31 04:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328385  13 58422 16540053 A  ERRORERROR'
2018-10-31 04:35:40 [DEBUG   ] Got command RPT from MCS: ref #328386
2018-10-31 04:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328386  77 58422 16540054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:35:49 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2018-10-31 04:35:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:35:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:35:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:35:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:35:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:35:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:35:50 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-10-31 04:36:09 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2018-10-31 04:36:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:36:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:36:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:36:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:36:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:36:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:36:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:36:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:36:50 [DEBUG   ] Finished updating board flags in 1.223 seconds
2018-10-31 04:37:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:37:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:37:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:37:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:37:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:37:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:37:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:37:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:37:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:37:50 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-31 04:38:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:38:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:38:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:38:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:38:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 04:38:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:38:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:38:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:38:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:38:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:38:50 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-31 04:39:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:39:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:39:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:39:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:39:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:39:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:39:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:39:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:39:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:39:50 [DEBUG   ] Finished updating board flags in 1.100 seconds
2018-10-31 04:40:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:40:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:40:29 [DEBUG   ] Got command RPT from MCS: ref #328410
2018-10-31 04:40:29 [DEBUG   ] summary = ERROR
2018-10-31 04:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328410  13 58422 16829465 A  ERRORERROR'
2018-10-31 04:40:29 [DEBUG   ] Got command RPT from MCS: ref #328411
2018-10-31 04:40:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328411  77 58422 16829657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:40:29 [DEBUG   ] Got command RPT from MCS: ref #328412
2018-10-31 04:40:29 [DEBUG   ] summary = ERROR
2018-10-31 04:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328412  13 58422 16829861 A  ERRORERROR'
2018-10-31 04:40:30 [DEBUG   ] Got command RPT from MCS: ref #328413
2018-10-31 04:40:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328413  77 58422 16830065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:40:30 [DEBUG   ] Got command RPT from MCS: ref #328414
2018-10-31 04:40:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 04:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328414  12 58422 16830269 A  ERRORB'
2018-10-31 04:40:40 [DEBUG   ] Got command RPT from MCS: ref #328415
2018-10-31 04:40:40 [DEBUG   ] summary = ERROR
2018-10-31 04:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328415  13 58422 16840049 A  ERRORERROR'
2018-10-31 04:40:40 [DEBUG   ] Got command RPT from MCS: ref #328416
2018-10-31 04:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328416  77 58422 16840050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:40:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:40:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:40:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 04:40:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:40:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:40:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:40:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:40:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:40:51 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-31 04:41:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:41:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:41:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:41:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 04:41:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:41:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:41:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:41:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:41:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:41:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:41:51 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-31 04:42:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:42:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:42:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:42:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:42:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:42:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:42:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:42:50 [WARNING ] (13, 1, 'bot')
2018-10-31 04:42:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:42:50 [DEBUG   ] Finished updating board flags in 1.223 seconds
2018-10-31 04:43:00 [DEBUG   ] Got command TBN from MCS: ref #328436
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-31 04:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   328436   8 58422 16980985 A  ERROR'
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540960982']
2018-10-31 04:43:00 [DEBUG   ] spawn_process: at 2018-10-31 04:43:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540960982']
2018-10-31 04:43:01 [DEBUG   ] spawn_process: at 2018-10-31 04:43:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540960982']
2018-10-31 04:43:01 [INFO    ] Finished spawning TBN in 0.045 s
2018-10-31 04:43:09 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2018-10-31 04:43:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:43:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:43:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 04:43:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:43:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:43:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:43:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:43:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:43:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:43:51 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-31 04:44:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:44:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:44:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:44:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 04:44:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:44:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:44:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:44:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:44:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:44:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:44:51 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-10-31 04:45:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:45:12 [DEBUG   ] Got command TBW from MCS: ref #328440
2018-10-31 04:45:12 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-31 04:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   328440   8 58422 17112050 A  ERROR'
2018-10-31 04:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-31 04:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-31 04:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-31 04:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-31 04:45:15 [DEBUG   ] spawn_process: at 2018-10-31 04:45:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-31 04:45:15 [INFO    ] Finished spawning TBW
2018-10-31 04:45:29 [DEBUG   ] Got command RPT from MCS: ref #328442
2018-10-31 04:45:29 [DEBUG   ] summary = ERROR
2018-10-31 04:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328442  13 58422 17129549 A  ERRORERROR'
2018-10-31 04:45:29 [DEBUG   ] Got command RPT from MCS: ref #328443
2018-10-31 04:45:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328443  77 58422 17129753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:45:29 [DEBUG   ] Got command RPT from MCS: ref #328444
2018-10-31 04:45:29 [DEBUG   ] summary = ERROR
2018-10-31 04:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328444  13 58422 17129945 A  ERRORERROR'
2018-10-31 04:45:30 [DEBUG   ] Got command RPT from MCS: ref #328446
2018-10-31 04:45:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328446  77 58422 17130149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:45:30 [DEBUG   ] Got command RPT from MCS: ref #328448
2018-10-31 04:45:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 04:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328448  12 58422 17130353 A  ERRORB'
2018-10-31 04:45:40 [DEBUG   ] Got command RPT from MCS: ref #328452
2018-10-31 04:45:40 [DEBUG   ] summary = ERROR
2018-10-31 04:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328452  13 58422 17140049 A  ERRORERROR'
2018-10-31 04:45:40 [DEBUG   ] Got command RPT from MCS: ref #328453
2018-10-31 04:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328453  77 58422 17140050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:45:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:45:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:45:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:45:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:45:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:45:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:45:51 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-31 04:46:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:46:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 04:46:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:46:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:46:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:46:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:46:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:46:51 [DEBUG   ] Finished updating board flags in 1.750 seconds
2018-10-31 04:47:03 [INFO    ] __waitForTBW - TBW finished in 108.316 s
2018-10-31 04:47:04 [DEBUG   ] Finished updating ant stats in 0.352 seconds
2018-10-31 04:47:04 [INFO    ] Started antennas statistics background thread
2018-10-31 04:47:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540961226']
2018-10-31 04:47:04 [DEBUG   ] spawn_process: at 2018-10-31 04:47:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540961226']
2018-10-31 04:47:04 [INFO    ] Finished spawning TBN in 0.052 s
2018-10-31 04:47:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2018-10-31 04:47:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 04:47:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:47:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:47:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:47:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:47:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:47:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:47:51 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-31 04:48:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 04:48:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 04:48:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 04:48:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:48:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:48:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:48:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:48:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:48:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:48:51 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-10-31 04:49:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 04:49:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 04:49:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 04:49:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 04:49:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:49:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:49:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:49:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:49:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:49:51 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-31 04:50:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 04:50:25 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-31 04:50:29 [DEBUG   ] Got command RPT from MCS: ref #328483
2018-10-31 04:50:29 [DEBUG   ] summary = ERROR
2018-10-31 04:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328483  13 58422 17429633 A  ERRORERROR'
2018-10-31 04:50:29 [DEBUG   ] Got command RPT from MCS: ref #328484
2018-10-31 04:50:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328484  77 58422 17429837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:50:30 [DEBUG   ] Got command RPT from MCS: ref #328485
2018-10-31 04:50:30 [DEBUG   ] summary = ERROR
2018-10-31 04:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328485  13 58422 17430029 A  ERRORERROR'
2018-10-31 04:50:30 [DEBUG   ] Got command RPT from MCS: ref #328486
2018-10-31 04:50:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328486  77 58422 17430233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:50:30 [DEBUG   ] Got command RPT from MCS: ref #328487
2018-10-31 04:50:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 04:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328487  12 58422 17430437 A  ERRORB'
2018-10-31 04:50:40 [DEBUG   ] Got command RPT from MCS: ref #328488
2018-10-31 04:50:40 [DEBUG   ] summary = ERROR
2018-10-31 04:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328488  13 58422 17440049 A  ERRORERROR'
2018-10-31 04:50:40 [DEBUG   ] Got command RPT from MCS: ref #328489
2018-10-31 04:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328489  77 58422 17440050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:50:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:50:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:50:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:50:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:50:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:50:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:50:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:50:51 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-10-31 04:51:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 04:51:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:51:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:51:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:51:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:51:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:51:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:51:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:51:51 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-10-31 04:52:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:52:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:52:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:52:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:52:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:52:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:52:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:52:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:52:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:52:51 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-31 04:53:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:53:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:53:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 04:53:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 04:53:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:53:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:53:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:53:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:53:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:53:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:53:51 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-10-31 04:54:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 04:54:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:54:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 04:54:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:54:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:54:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:54:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:54:51 [WARNING ] (13, 1, 'bot')
2018-10-31 04:54:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:54:51 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-10-31 04:55:05 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-31 04:55:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 04:55:29 [DEBUG   ] Got command RPT from MCS: ref #328515
2018-10-31 04:55:29 [DEBUG   ] summary = ERROR
2018-10-31 04:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328515  13 58422 17729718 A  ERRORERROR'
2018-10-31 04:55:29 [DEBUG   ] Got command RPT from MCS: ref #328516
2018-10-31 04:55:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328516  77 58422 17729931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:55:30 [DEBUG   ] Got command RPT from MCS: ref #328517
2018-10-31 04:55:30 [DEBUG   ] summary = ERROR
2018-10-31 04:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328517  13 58422 17730121 A  ERRORERROR'
2018-10-31 04:55:30 [DEBUG   ] Got command RPT from MCS: ref #328519
2018-10-31 04:55:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328519  77 58422 17730313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:55:30 [DEBUG   ] Got command RPT from MCS: ref #328520
2018-10-31 04:55:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 04:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328520  12 58422 17730518 A  ERRORB'
2018-10-31 04:55:40 [DEBUG   ] Got command RPT from MCS: ref #328525
2018-10-31 04:55:40 [DEBUG   ] summary = ERROR
2018-10-31 04:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328525  13 58422 17740057 A  ERRORERROR'
2018-10-31 04:55:40 [DEBUG   ] Got command RPT from MCS: ref #328526
2018-10-31 04:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 04:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328526  77 58422 17740058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 04:55:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 04:55:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:55:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 04:55:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:55:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:55:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:55:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:55:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:55:52 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-10-31 04:56:05 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 04:56:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-31 04:56:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 04:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 04:56:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:56:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:56:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:56:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:56:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:56:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:56:52 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-31 04:57:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 04:57:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 04:57:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 04:57:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:57:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:57:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:57:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:57:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:57:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:57:52 [DEBUG   ] Finished updating board flags in 2.334 seconds
2018-10-31 04:58:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 04:58:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 04:58:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 04:58:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:58:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 04:58:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:58:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:58:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:58:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:58:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:58:52 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-31 04:59:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-31 04:59:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 04:59:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 04:59:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 04:59:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:59:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:59:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:59:52 [WARNING ] (13, 1, 'bot')
2018-10-31 04:59:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 04:59:52 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-31 05:00:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:00:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:00:29 [DEBUG   ] Got command RPT from MCS: ref #328546
2018-10-31 05:00:29 [DEBUG   ] summary = ERROR
2018-10-31 05:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328546  13 58422 18029805 A  ERRORERROR'
2018-10-31 05:00:29 [DEBUG   ] Got command RPT from MCS: ref #328547
2018-10-31 05:00:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328547  77 58422 18029997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:00:30 [DEBUG   ] Got command RPT from MCS: ref #328548
2018-10-31 05:00:30 [DEBUG   ] summary = ERROR
2018-10-31 05:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328548  13 58422 18030201 A  ERRORERROR'
2018-10-31 05:00:30 [DEBUG   ] Got command RPT from MCS: ref #328549
2018-10-31 05:00:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328549  77 58422 18030405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:00:30 [DEBUG   ] Got command RPT from MCS: ref #328550
2018-10-31 05:00:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328550  12 58422 18030609 A  ERRORB'
2018-10-31 05:00:40 [DEBUG   ] Got command RPT from MCS: ref #328551
2018-10-31 05:00:40 [DEBUG   ] summary = ERROR
2018-10-31 05:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328551  13 58422 18040053 A  ERRORERROR'
2018-10-31 05:00:40 [DEBUG   ] Got command RPT from MCS: ref #328552
2018-10-31 05:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328552  77 58422 18040054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:00:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:00:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:00:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:00:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:00:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:00:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:00:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:00:52 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-31 05:01:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:01:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:01:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 05:01:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:01:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:01:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:01:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:01:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:01:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:01:52 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-31 05:02:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 05:02:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 05:02:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:02:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 05:02:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:02:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:02:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:02:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:02:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:02:52 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-31 05:03:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:03:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:03:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 05:03:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:03:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:03:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:03:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:03:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:03:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:03:52 [DEBUG   ] Finished updating board flags in 1.722 seconds
2018-10-31 05:04:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:04:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:04:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:04:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:04:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 05:04:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:04:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:04:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:04:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:04:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:04:52 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-10-31 05:05:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:05:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:05:29 [DEBUG   ] Got command RPT from MCS: ref #328578
2018-10-31 05:05:29 [DEBUG   ] summary = ERROR
2018-10-31 05:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328578  13 58422 18329881 A  ERRORERROR'
2018-10-31 05:05:30 [DEBUG   ] Got command RPT from MCS: ref #328579
2018-10-31 05:05:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328579  77 58422 18330085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:05:30 [DEBUG   ] Got command RPT from MCS: ref #328580
2018-10-31 05:05:30 [DEBUG   ] summary = ERROR
2018-10-31 05:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328580  13 58422 18330289 A  ERRORERROR'
2018-10-31 05:05:30 [DEBUG   ] Got command RPT from MCS: ref #328582
2018-10-31 05:05:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328582  77 58422 18330493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:05:30 [DEBUG   ] Got command RPT from MCS: ref #328583
2018-10-31 05:05:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328583  12 58422 18330685 A  ERRORB'
2018-10-31 05:05:40 [DEBUG   ] Got command RPT from MCS: ref #328588
2018-10-31 05:05:40 [DEBUG   ] summary = ERROR
2018-10-31 05:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328588  13 58422 18340057 A  ERRORERROR'
2018-10-31 05:05:40 [DEBUG   ] Got command RPT from MCS: ref #328589
2018-10-31 05:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328589  77 58422 18340058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:05:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:05:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:05:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:05:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:05:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:05:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:05:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:05:52 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-31 05:06:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 05:06:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 05:06:46 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-31 05:06:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:06:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:06:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:06:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:06:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:06:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:06:52 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-10-31 05:07:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 05:07:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 05:07:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:07:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:07:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:07:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:07:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:07:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:07:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:07:52 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-31 05:08:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:08:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:08:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:08:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:08:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:08:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:08:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:08:52 [WARNING ] (13, 1, 'bot')
2018-10-31 05:08:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:08:52 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-10-31 05:09:07 [DEBUG   ] Finished updating ant stats in 1.010 seconds
2018-10-31 05:09:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 05:09:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 05:09:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:09:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:09:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:09:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:09:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:09:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:09:53 [DEBUG   ] Finished updating board flags in 2.151 seconds
2018-10-31 05:10:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 05:10:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 05:10:29 [DEBUG   ] Got command RPT from MCS: ref #328613
2018-10-31 05:10:29 [DEBUG   ] summary = ERROR
2018-10-31 05:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328613  13 58422 18629970 A  ERRORERROR'
2018-10-31 05:10:30 [DEBUG   ] Got command RPT from MCS: ref #328614
2018-10-31 05:10:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328614  77 58422 18630173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:10:30 [DEBUG   ] Got command RPT from MCS: ref #328615
2018-10-31 05:10:30 [DEBUG   ] summary = ERROR
2018-10-31 05:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328615  13 58422 18630377 A  ERRORERROR'
2018-10-31 05:10:30 [DEBUG   ] Got command RPT from MCS: ref #328616
2018-10-31 05:10:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328616  77 58422 18630581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:10:30 [DEBUG   ] Got command RPT from MCS: ref #328617
2018-10-31 05:10:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328617  12 58422 18630774 A  ERRORB'
2018-10-31 05:10:40 [DEBUG   ] Got command RPT from MCS: ref #328618
2018-10-31 05:10:40 [DEBUG   ] summary = ERROR
2018-10-31 05:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328618  13 58422 18640061 A  ERRORERROR'
2018-10-31 05:10:40 [DEBUG   ] Got command RPT from MCS: ref #328619
2018-10-31 05:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328619  77 58422 18640062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:10:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 05:10:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:10:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:10:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:10:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:10:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:10:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:10:53 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-31 05:11:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 05:11:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 05:11:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 05:11:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:11:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:11:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:11:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:11:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:11:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:11:53 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-31 05:12:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 05:12:27 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-10-31 05:12:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:12:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:12:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:12:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:12:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:12:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:12:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:12:53 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-31 05:13:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:13:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:13:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:13:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:13:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:13:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:13:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:13:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:13:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:13:53 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-10-31 05:14:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:14:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:14:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-31 05:14:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:14:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:14:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:14:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:14:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:14:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:14:53 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-10-31 05:15:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:15:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:15:30 [DEBUG   ] Got command RPT from MCS: ref #328641
2018-10-31 05:15:30 [DEBUG   ] summary = ERROR
2018-10-31 05:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328641  13 58422 18930057 A  ERRORERROR'
2018-10-31 05:15:30 [DEBUG   ] Got command RPT from MCS: ref #328642
2018-10-31 05:15:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328642  77 58422 18930261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:15:30 [DEBUG   ] Got command RPT from MCS: ref #328643
2018-10-31 05:15:30 [DEBUG   ] summary = ERROR
2018-10-31 05:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328643  13 58422 18930453 A  ERRORERROR'
2018-10-31 05:15:30 [DEBUG   ] Got command RPT from MCS: ref #328645
2018-10-31 05:15:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328645  77 58422 18930657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:15:30 [DEBUG   ] Got command RPT from MCS: ref #328647
2018-10-31 05:15:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328647  12 58422 18930861 A  ERRORB'
2018-10-31 05:15:40 [DEBUG   ] Got command RPT from MCS: ref #328651
2018-10-31 05:15:40 [DEBUG   ] summary = ERROR
2018-10-31 05:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328651  13 58422 18940053 A  ERRORERROR'
2018-10-31 05:15:40 [DEBUG   ] Got command RPT from MCS: ref #328652
2018-10-31 05:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328652  77 58422 18940054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:15:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:15:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:15:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:15:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:15:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:15:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:15:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:15:53 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-31 05:16:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:16:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:16:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:16:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:16:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:16:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:16:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:16:53 [WARNING ] (13, 1, 'bot')
2018-10-31 05:16:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:16:53 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-10-31 05:17:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:17:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:17:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:17:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:17:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:17:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:17:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:17:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:17:54 [DEBUG   ] Finished updating board flags in 2.276 seconds
2018-10-31 05:18:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:18:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:18:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:18:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 05:18:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:18:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:18:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:18:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:18:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:18:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:18:54 [DEBUG   ] Finished updating board flags in 2.235 seconds
2018-10-31 05:19:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:19:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:19:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:19:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:19:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:19:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:19:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:19:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:19:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:19:54 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-31 05:20:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:20:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:20:30 [DEBUG   ] Got command RPT from MCS: ref #328676
2018-10-31 05:20:30 [DEBUG   ] summary = ERROR
2018-10-31 05:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328676  13 58422 19230141 A  ERRORERROR'
2018-10-31 05:20:30 [DEBUG   ] Got command RPT from MCS: ref #328677
2018-10-31 05:20:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328677  77 58422 19230345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:20:30 [DEBUG   ] Got command RPT from MCS: ref #328678
2018-10-31 05:20:30 [DEBUG   ] summary = ERROR
2018-10-31 05:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328678  13 58422 19230549 A  ERRORERROR'
2018-10-31 05:20:30 [DEBUG   ] Got command RPT from MCS: ref #328679
2018-10-31 05:20:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328679  77 58422 19230753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:20:30 [DEBUG   ] Got command RPT from MCS: ref #328680
2018-10-31 05:20:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328680  12 58422 19230945 A  ERRORB'
2018-10-31 05:20:40 [DEBUG   ] Got command RPT from MCS: ref #328681
2018-10-31 05:20:40 [DEBUG   ] summary = ERROR
2018-10-31 05:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328681  13 58422 19240065 A  ERRORERROR'
2018-10-31 05:20:40 [DEBUG   ] Got command RPT from MCS: ref #328682
2018-10-31 05:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328682  77 58422 19240066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:20:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:20:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:20:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:20:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:20:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:20:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:20:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:20:54 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-10-31 05:21:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:21:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:21:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:21:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 05:21:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:21:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:21:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:21:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:21:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:21:54 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-31 05:22:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:22:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:22:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:22:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:22:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:22:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:22:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:22:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:22:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:22:54 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-31 05:23:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:23:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 05:23:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:23:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:23:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:23:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:23:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:23:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:23:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:23:54 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-31 05:24:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:24:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:24:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:24:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:24:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:24:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:24:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:24:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:24:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:24:54 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-10-31 05:25:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:25:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:25:30 [DEBUG   ] Got command RPT from MCS: ref #328708
2018-10-31 05:25:30 [DEBUG   ] summary = ERROR
2018-10-31 05:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328708  13 58422 19530233 A  ERRORERROR'
2018-10-31 05:25:30 [DEBUG   ] Got command RPT from MCS: ref #328709
2018-10-31 05:25:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328709  77 58422 19530437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:25:30 [DEBUG   ] Got command RPT from MCS: ref #328710
2018-10-31 05:25:30 [DEBUG   ] summary = ERROR
2018-10-31 05:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328710  13 58422 19530629 A  ERRORERROR'
2018-10-31 05:25:30 [DEBUG   ] Got command RPT from MCS: ref #328712
2018-10-31 05:25:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328712  77 58422 19530833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:25:31 [DEBUG   ] Got command RPT from MCS: ref #328713
2018-10-31 05:25:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328713  12 58422 19531037 A  ERRORB'
2018-10-31 05:25:40 [DEBUG   ] Got command RPT from MCS: ref #328718
2018-10-31 05:25:40 [DEBUG   ] summary = ERROR
2018-10-31 05:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328718  13 58422 19540061 A  ERRORERROR'
2018-10-31 05:25:40 [DEBUG   ] Got command RPT from MCS: ref #328719
2018-10-31 05:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328719  77 58422 19540062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:25:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:25:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:25:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:25:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:25:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:25:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:25:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:25:54 [DEBUG   ] Finished updating board flags in 1.894 seconds
2018-10-31 05:26:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:26:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:26:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:26:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:26:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:26:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:26:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:26:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:26:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:26:54 [DEBUG   ] Finished updating board flags in 1.702 seconds
2018-10-31 05:27:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:27:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:27:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:27:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:27:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:27:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:27:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:27:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:27:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:27:54 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-31 05:28:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:28:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:28:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:28:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:28:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:28:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:28:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:28:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:28:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:28:54 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-31 05:29:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:29:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:29:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:29:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:29:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:29:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:29:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:29:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:29:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:29:54 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-10-31 05:30:08 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-31 05:30:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 05:30:30 [DEBUG   ] Got command RPT from MCS: ref #328739
2018-10-31 05:30:30 [DEBUG   ] summary = ERROR
2018-10-31 05:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328739  13 58422 19830313 A  ERRORERROR'
2018-10-31 05:30:30 [DEBUG   ] Got command RPT from MCS: ref #328740
2018-10-31 05:30:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328740  77 58422 19830517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:30:30 [DEBUG   ] Got command RPT from MCS: ref #328741
2018-10-31 05:30:30 [DEBUG   ] summary = ERROR
2018-10-31 05:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328741  13 58422 19830721 A  ERRORERROR'
2018-10-31 05:30:30 [DEBUG   ] Got command RPT from MCS: ref #328742
2018-10-31 05:30:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328742  77 58422 19830925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:30:31 [DEBUG   ] Got command RPT from MCS: ref #328743
2018-10-31 05:30:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328743  12 58422 19831117 A  ERRORB'
2018-10-31 05:30:40 [DEBUG   ] Got command RPT from MCS: ref #328744
2018-10-31 05:30:40 [DEBUG   ] summary = ERROR
2018-10-31 05:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328744  13 58422 19840069 A  ERRORERROR'
2018-10-31 05:30:40 [DEBUG   ] Got command RPT from MCS: ref #328745
2018-10-31 05:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328745  77 58422 19840070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:30:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 05:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:30:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:30:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:30:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:30:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:30:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:30:54 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-31 05:31:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 05:31:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 05:31:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 05:31:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:31:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:31:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:31:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:31:54 [WARNING ] (13, 1, 'bot')
2018-10-31 05:31:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:31:54 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-10-31 05:32:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 05:32:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:32:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:32:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:32:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:32:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:32:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:32:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:32:55 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-10-31 05:33:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:33:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:33:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:33:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:33:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:33:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:33:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:33:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:33:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:33:55 [DEBUG   ] Finished updating board flags in 2.286 seconds
2018-10-31 05:34:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:34:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:34:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:34:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:34:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:34:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:34:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:34:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:34:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:34:55 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-10-31 05:35:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 05:35:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:35:30 [DEBUG   ] Got command RPT from MCS: ref #328771
2018-10-31 05:35:30 [DEBUG   ] summary = ERROR
2018-10-31 05:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328771  13 58422 20130409 A  ERRORERROR'
2018-10-31 05:35:30 [DEBUG   ] Got command RPT from MCS: ref #328772
2018-10-31 05:35:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328772  77 58422 20130601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:35:30 [DEBUG   ] Got command RPT from MCS: ref #328773
2018-10-31 05:35:30 [DEBUG   ] summary = ERROR
2018-10-31 05:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328773  13 58422 20130805 A  ERRORERROR'
2018-10-31 05:35:31 [DEBUG   ] Got command RPT from MCS: ref #328775
2018-10-31 05:35:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:35:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328775  77 58422 20131009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:35:31 [DEBUG   ] Got command RPT from MCS: ref #328776
2018-10-31 05:35:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:35:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328776  12 58422 20131213 A  ERRORB'
2018-10-31 05:35:40 [DEBUG   ] Got command RPT from MCS: ref #328781
2018-10-31 05:35:40 [DEBUG   ] summary = ERROR
2018-10-31 05:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328781  13 58422 20140061 A  ERRORERROR'
2018-10-31 05:35:40 [DEBUG   ] Got command RPT from MCS: ref #328782
2018-10-31 05:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328782  77 58422 20140062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:35:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:35:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 05:35:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:35:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:35:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:35:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:35:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:35:55 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-10-31 05:36:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:36:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 05:36:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 05:36:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:36:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:36:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:36:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:36:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:36:55 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-31 05:37:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:37:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:37:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:37:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:37:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:37:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:37:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:37:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:37:55 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-31 05:38:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:38:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:38:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:38:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:38:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:38:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:38:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:38:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:38:55 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-31 05:39:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:39:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 05:39:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:39:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:39:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:39:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:39:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:39:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:39:55 [DEBUG   ] Finished updating board flags in 1.909 seconds
2018-10-31 05:40:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:40:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 05:40:30 [DEBUG   ] Got command RPT from MCS: ref #328806
2018-10-31 05:40:30 [DEBUG   ] summary = ERROR
2018-10-31 05:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328806  13 58422 20430493 A  ERRORERROR'
2018-10-31 05:40:30 [DEBUG   ] Got command RPT from MCS: ref #328807
2018-10-31 05:40:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328807  77 58422 20430697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:40:30 [DEBUG   ] Got command RPT from MCS: ref #328808
2018-10-31 05:40:30 [DEBUG   ] summary = ERROR
2018-10-31 05:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328808  13 58422 20430889 A  ERRORERROR'
2018-10-31 05:40:31 [DEBUG   ] Got command RPT from MCS: ref #328809
2018-10-31 05:40:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328809  77 58422 20431093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:40:31 [DEBUG   ] Got command RPT from MCS: ref #328810
2018-10-31 05:40:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328810  12 58422 20431297 A  ERRORB'
2018-10-31 05:40:40 [DEBUG   ] Got command RPT from MCS: ref #328811
2018-10-31 05:40:40 [DEBUG   ] summary = ERROR
2018-10-31 05:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328811  13 58422 20440069 A  ERRORERROR'
2018-10-31 05:40:40 [DEBUG   ] Got command RPT from MCS: ref #328812
2018-10-31 05:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328812  77 58422 20440070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:40:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:40:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:40:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:40:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:40:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:40:55 [DEBUG   ] Finished updating board flags in 1.701 seconds
2018-10-31 05:41:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 05:41:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 05:41:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 05:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:41:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:41:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:41:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:41:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:41:55 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-10-31 05:42:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:42:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 05:42:48 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 05:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:42:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:42:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:42:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:42:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:42:55 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-10-31 05:43:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:43:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:43:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:43:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 05:43:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:43:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:43:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:43:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:43:55 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-31 05:44:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:44:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:44:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 05:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:44:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 05:44:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:44:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:44:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:44:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:44:55 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-31 05:45:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:45:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 05:45:30 [DEBUG   ] Got command RPT from MCS: ref #328834
2018-10-31 05:45:30 [DEBUG   ] summary = ERROR
2018-10-31 05:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328834  13 58422 20730573 A  ERRORERROR'
2018-10-31 05:45:30 [DEBUG   ] Got command RPT from MCS: ref #328835
2018-10-31 05:45:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328835  77 58422 20730777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:45:30 [DEBUG   ] Got command RPT from MCS: ref #328836
2018-10-31 05:45:30 [DEBUG   ] summary = ERROR
2018-10-31 05:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328836  13 58422 20730981 A  ERRORERROR'
2018-10-31 05:45:31 [DEBUG   ] Got command RPT from MCS: ref #328838
2018-10-31 05:45:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328838  77 58422 20731185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:45:31 [DEBUG   ] Got command RPT from MCS: ref #328839
2018-10-31 05:45:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328839  12 58422 20731377 A  ERRORB'
2018-10-31 05:45:40 [DEBUG   ] Got command RPT from MCS: ref #328844
2018-10-31 05:45:40 [DEBUG   ] summary = ERROR
2018-10-31 05:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328844  13 58422 20740065 A  ERRORERROR'
2018-10-31 05:45:40 [DEBUG   ] Got command RPT from MCS: ref #328845
2018-10-31 05:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328845  77 58422 20740066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:45:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:45:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:45:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:45:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:45:55 [WARNING ] (13, 1, 'bot')
2018-10-31 05:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:45:55 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-31 05:46:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:46:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 05:46:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 05:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:46:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:46:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:46:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:46:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:46:56 [DEBUG   ] Finished updating board flags in 2.236 seconds
2018-10-31 05:47:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 05:47:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 05:47:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 05:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:47:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:47:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:47:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:47:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:47:56 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-10-31 05:48:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 05:48:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:48:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 05:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:48:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:48:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:48:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:48:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:48:56 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-31 05:49:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:49:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:49:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:49:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:49:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:49:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:49:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:49:56 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-31 05:50:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 05:50:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 05:50:30 [DEBUG   ] Got command RPT from MCS: ref #328869
2018-10-31 05:50:30 [DEBUG   ] summary = ERROR
2018-10-31 05:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328869  13 58422 21030665 A  ERRORERROR'
2018-10-31 05:50:30 [DEBUG   ] Got command RPT from MCS: ref #328870
2018-10-31 05:50:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328870  77 58422 21030869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:50:31 [DEBUG   ] Got command RPT from MCS: ref #328871
2018-10-31 05:50:31 [DEBUG   ] summary = ERROR
2018-10-31 05:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328871  13 58422 21031061 A  ERRORERROR'
2018-10-31 05:50:31 [DEBUG   ] Got command RPT from MCS: ref #328872
2018-10-31 05:50:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328872  77 58422 21031265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:50:31 [DEBUG   ] Got command RPT from MCS: ref #328873
2018-10-31 05:50:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328873  12 58422 21031491 A  ERRORB'
2018-10-31 05:50:40 [DEBUG   ] Got command RPT from MCS: ref #328874
2018-10-31 05:50:40 [DEBUG   ] summary = ERROR
2018-10-31 05:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328874  13 58422 21040069 A  ERRORERROR'
2018-10-31 05:50:40 [DEBUG   ] Got command RPT from MCS: ref #328875
2018-10-31 05:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328875  77 58422 21040070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:50:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:50:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:50:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:50:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:50:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:50:56 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-31 05:51:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:51:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 05:51:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 05:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:51:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:51:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:51:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:51:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:51:56 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-31 05:52:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 05:52:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 05:52:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 05:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 05:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-31 05:52:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:52:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:52:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:52:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:52:56 [WARNING ] (25, 5, 'bot')
2018-10-31 05:52:56 [WARNING ] (25, 5, 'bot')
2018-10-31 05:52:56 [WARNING ] (25, 5, 'bot')
2018-10-31 05:52:56 [WARNING ] (25, 5, 'bot')
2018-10-31 05:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:52:56 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-31 05:53:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 05:53:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 05:53:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 05:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:53:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:53:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:53:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:53:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:53:56 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-31 05:54:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-31 05:54:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 05:54:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 05:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:54:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:54:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:54:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:54:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:54:56 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-31 05:55:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 05:55:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 05:55:30 [DEBUG   ] Got command RPT from MCS: ref #328901
2018-10-31 05:55:30 [DEBUG   ] summary = ERROR
2018-10-31 05:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328901  13 58422 21330749 A  ERRORERROR'
2018-10-31 05:55:30 [DEBUG   ] Got command RPT from MCS: ref #328902
2018-10-31 05:55:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328902  77 58422 21330953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:55:31 [DEBUG   ] Got command RPT from MCS: ref #328903
2018-10-31 05:55:31 [DEBUG   ] summary = ERROR
2018-10-31 05:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328903  13 58422 21331145 A  ERRORERROR'
2018-10-31 05:55:31 [DEBUG   ] Got command RPT from MCS: ref #328905
2018-10-31 05:55:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328905  77 58422 21331349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:55:31 [DEBUG   ] Got command RPT from MCS: ref #328907
2018-10-31 05:55:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 05:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328907  12 58422 21331553 A  ERRORB'
2018-10-31 05:55:40 [DEBUG   ] Got command RPT from MCS: ref #328911
2018-10-31 05:55:40 [DEBUG   ] summary = ERROR
2018-10-31 05:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328911  13 58422 21340073 A  ERRORERROR'
2018-10-31 05:55:40 [DEBUG   ] Got command RPT from MCS: ref #328912
2018-10-31 05:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 05:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328912  77 58422 21340074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 05:55:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:55:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:55:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:55:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:55:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:55:56 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-31 05:56:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 05:56:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 05:56:50 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 05:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-31 05:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:56:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:56:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:56:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:56:56 [WARNING ] (13, 1, 'bot')
2018-10-31 05:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:56:56 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-31 05:57:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 05:57:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 05:57:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 05:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:57:57 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-31 05:58:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 05:58:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 05:58:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 05:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:58:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:58:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:58:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:58:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:58:57 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-31 05:59:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:59:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 05:59:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 05:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 05:59:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:59:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:59:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:59:57 [WARNING ] (13, 1, 'bot')
2018-10-31 05:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 05:59:57 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-31 06:00:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:00:30 [DEBUG   ] Got command RPT from MCS: ref #328932
2018-10-31 06:00:30 [DEBUG   ] summary = ERROR
2018-10-31 06:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328932  13 58422 21630837 A  ERRORERROR'
2018-10-31 06:00:31 [DEBUG   ] Got command RPT from MCS: ref #328933
2018-10-31 06:00:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328933  77 58422 21631033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:00:31 [DEBUG   ] Got command RPT from MCS: ref #328934
2018-10-31 06:00:31 [DEBUG   ] summary = ERROR
2018-10-31 06:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328934  13 58422 21631233 A  ERRORERROR'
2018-10-31 06:00:31 [DEBUG   ] Got command RPT from MCS: ref #328935
2018-10-31 06:00:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328935  77 58422 21631437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:00:31 [DEBUG   ] Got command RPT from MCS: ref #328936
2018-10-31 06:00:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328936  12 58422 21631641 A  ERRORB'
2018-10-31 06:00:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-31 06:00:40 [DEBUG   ] Got command RPT from MCS: ref #328937
2018-10-31 06:00:40 [DEBUG   ] summary = ERROR
2018-10-31 06:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328937  13 58422 21640069 A  ERRORERROR'
2018-10-31 06:00:40 [DEBUG   ] Got command RPT from MCS: ref #328938
2018-10-31 06:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328938  77 58422 21640070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:00:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 06:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 06:00:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:00:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:00:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:00:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:00:57 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-31 06:01:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 06:01:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 06:01:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 06:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:01:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:01:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:01:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:01:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:01:57 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-31 06:02:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 06:02:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 06:02:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 06:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:02:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:02:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:02:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:02:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:02:57 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-31 06:03:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 06:03:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 06:03:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 06:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:03:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:03:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:03:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:03:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:03:57 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-31 06:04:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:04:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 06:04:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:04:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:04:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:04:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:04:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:04:57 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-31 06:05:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:05:30 [DEBUG   ] Got command RPT from MCS: ref #328964
2018-10-31 06:05:30 [DEBUG   ] summary = ERROR
2018-10-31 06:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328964  13 58422 21930921 A  ERRORERROR'
2018-10-31 06:05:31 [DEBUG   ] Got command RPT from MCS: ref #328965
2018-10-31 06:05:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328965  77 58422 21931125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:05:31 [DEBUG   ] Got command RPT from MCS: ref #328966
2018-10-31 06:05:31 [DEBUG   ] summary = ERROR
2018-10-31 06:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328966  13 58422 21931317 A  ERRORERROR'
2018-10-31 06:05:31 [DEBUG   ] Got command RPT from MCS: ref #328968
2018-10-31 06:05:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328968  77 58422 21931521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:05:31 [DEBUG   ] Got command RPT from MCS: ref #328970
2018-10-31 06:05:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328970  12 58422 21931725 A  ERRORB'
2018-10-31 06:05:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 06:05:40 [DEBUG   ] Got command RPT from MCS: ref #328974
2018-10-31 06:05:40 [DEBUG   ] summary = ERROR
2018-10-31 06:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328974  13 58422 21940069 A  ERRORERROR'
2018-10-31 06:05:40 [DEBUG   ] Got command RPT from MCS: ref #328975
2018-10-31 06:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328975  77 58422 21940070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:05:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:05:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:05:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:05:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:05:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:05:57 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-31 06:06:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:06:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 06:06:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 06:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:06:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:06:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:06:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:06:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:06:57 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-31 06:07:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:07:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:07:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 06:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:07:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:07:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:07:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:07:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:07:57 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-31 06:08:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 06:08:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 06:08:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 06:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:08:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:08:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:08:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:08:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:08:57 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-31 06:09:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 06:09:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:09:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:09:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:09:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:09:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:09:57 [WARNING ] (13, 1, 'bot')
2018-10-31 06:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:09:57 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-31 06:10:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 06:10:31 [DEBUG   ] Got command RPT from MCS: ref #328999
2018-10-31 06:10:31 [DEBUG   ] summary = ERROR
2018-10-31 06:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   328999  13 58422 22231001 A  ERRORERROR'
2018-10-31 06:10:31 [DEBUG   ] Got command RPT from MCS: ref #329000
2018-10-31 06:10:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329000  77 58422 22231205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:10:31 [DEBUG   ] Got command RPT from MCS: ref #329001
2018-10-31 06:10:31 [DEBUG   ] summary = ERROR
2018-10-31 06:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329001  13 58422 22231409 A  ERRORERROR'
2018-10-31 06:10:31 [DEBUG   ] Got command RPT from MCS: ref #329002
2018-10-31 06:10:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329002  77 58422 22231613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:10:31 [DEBUG   ] Got command RPT from MCS: ref #329003
2018-10-31 06:10:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329003  12 58422 22231805 A  ERRORB'
2018-10-31 06:10:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 06:10:40 [DEBUG   ] Got command RPT from MCS: ref #329004
2018-10-31 06:10:40 [DEBUG   ] summary = ERROR
2018-10-31 06:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329004  13 58422 22240069 A  ERRORERROR'
2018-10-31 06:10:40 [DEBUG   ] Got command RPT from MCS: ref #329005
2018-10-31 06:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329005  77 58422 22240070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:10:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:10:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:10:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:10:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:10:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:10:58 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-10-31 06:11:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:11:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:11:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 06:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:11:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:11:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:11:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:11:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:11:58 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-31 06:12:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 06:12:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 06:12:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 06:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:12:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:12:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:12:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:12:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:12:58 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-31 06:13:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 06:13:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 06:13:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 06:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:13:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:13:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:13:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:13:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:13:58 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-10-31 06:14:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 06:14:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:14:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:14:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:14:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:14:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:14:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:14:58 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-10-31 06:15:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 06:15:31 [DEBUG   ] Got command RPT from MCS: ref #329027
2018-10-31 06:15:31 [DEBUG   ] summary = ERROR
2018-10-31 06:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329027  13 58422 22531085 A  ERRORERROR'
2018-10-31 06:15:31 [DEBUG   ] Got command RPT from MCS: ref #329028
2018-10-31 06:15:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329028  77 58422 22531289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:15:31 [DEBUG   ] Got command RPT from MCS: ref #329029
2018-10-31 06:15:31 [DEBUG   ] summary = ERROR
2018-10-31 06:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329029  13 58422 22531493 A  ERRORERROR'
2018-10-31 06:15:31 [DEBUG   ] Got command RPT from MCS: ref #329031
2018-10-31 06:15:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329031  77 58422 22531697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:15:31 [DEBUG   ] Got command RPT from MCS: ref #329032
2018-10-31 06:15:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329032  12 58422 22531889 A  ERRORB'
2018-10-31 06:15:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:15:40 [DEBUG   ] Got command RPT from MCS: ref #329037
2018-10-31 06:15:40 [DEBUG   ] summary = ERROR
2018-10-31 06:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329037  13 58422 22540077 A  ERRORERROR'
2018-10-31 06:15:40 [DEBUG   ] Got command RPT from MCS: ref #329038
2018-10-31 06:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329038  77 58422 22540078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:15:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:15:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:15:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:15:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:15:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:15:58 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-31 06:16:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:16:34 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-31 06:16:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 06:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:16:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:16:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:16:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:16:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:16:58 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-31 06:17:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 06:17:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 06:17:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 06:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 06:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:17:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:17:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:17:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:17:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:17:58 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-31 06:18:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 06:18:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 06:18:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 06:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:18:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:18:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:18:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:18:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:18:58 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-31 06:19:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 06:19:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 06:19:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 06:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:19:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:19:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:19:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:19:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:19:58 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-31 06:20:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:20:31 [DEBUG   ] Got command RPT from MCS: ref #329062
2018-10-31 06:20:31 [DEBUG   ] summary = ERROR
2018-10-31 06:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329062  13 58422 22831173 A  ERRORERROR'
2018-10-31 06:20:31 [DEBUG   ] Got command RPT from MCS: ref #329063
2018-10-31 06:20:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329063  77 58422 22831377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:20:31 [DEBUG   ] Got command RPT from MCS: ref #329064
2018-10-31 06:20:31 [DEBUG   ] summary = ERROR
2018-10-31 06:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329064  13 58422 22831581 A  ERRORERROR'
2018-10-31 06:20:31 [DEBUG   ] Got command RPT from MCS: ref #329065
2018-10-31 06:20:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329065  77 58422 22831773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:20:31 [DEBUG   ] Got command RPT from MCS: ref #329066
2018-10-31 06:20:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329066  12 58422 22831977 A  ERRORB'
2018-10-31 06:20:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:20:40 [DEBUG   ] Got command RPT from MCS: ref #329067
2018-10-31 06:20:40 [DEBUG   ] summary = ERROR
2018-10-31 06:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329067  13 58422 22840081 A  ERRORERROR'
2018-10-31 06:20:40 [DEBUG   ] Got command RPT from MCS: ref #329068
2018-10-31 06:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329068  77 58422 22840082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:20:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 06:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 06:20:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:20:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:20:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:20:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:20:58 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-10-31 06:21:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 06:21:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 06:21:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:21:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:21:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:21:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:21:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:21:58 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-31 06:22:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:22:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:22:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 06:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:22:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:22:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:22:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:22:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:22:58 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-10-31 06:23:15 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-31 06:23:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-31 06:23:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 06:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 06:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:23:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:23:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:23:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:23:58 [WARNING ] (13, 1, 'bot')
2018-10-31 06:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:23:58 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-31 06:24:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 06:24:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 06:24:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 06:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:24:59 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-10-31 06:25:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 06:25:31 [DEBUG   ] Got command RPT from MCS: ref #329094
2018-10-31 06:25:31 [DEBUG   ] summary = ERROR
2018-10-31 06:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329094  13 58422 23131257 A  ERRORERROR'
2018-10-31 06:25:31 [DEBUG   ] Got command RPT from MCS: ref #329095
2018-10-31 06:25:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329095  77 58422 23131461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:25:31 [DEBUG   ] Got command RPT from MCS: ref #329096
2018-10-31 06:25:31 [DEBUG   ] summary = ERROR
2018-10-31 06:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329096  13 58422 23131665 A  ERRORERROR'
2018-10-31 06:25:31 [DEBUG   ] Got command RPT from MCS: ref #329098
2018-10-31 06:25:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329098  77 58422 23131857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:25:32 [DEBUG   ] Got command RPT from MCS: ref #329100
2018-10-31 06:25:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329100  12 58422 23132061 A  ERRORB'
2018-10-31 06:25:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 06:25:40 [DEBUG   ] Got command RPT from MCS: ref #329104
2018-10-31 06:25:40 [DEBUG   ] summary = ERROR
2018-10-31 06:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329104  13 58422 23140077 A  ERRORERROR'
2018-10-31 06:25:40 [DEBUG   ] Got command RPT from MCS: ref #329105
2018-10-31 06:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329105  77 58422 23140078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:25:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 06:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:25:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:25:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:25:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:25:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:25:59 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-31 06:26:16 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-31 06:26:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 06:26:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:26:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:26:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:26:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:26:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:26:59 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-31 06:27:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 06:27:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:27:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 06:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:27:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:27:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:27:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:27:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:27:59 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-31 06:28:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 06:28:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 06:28:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:28:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:28:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:28:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:28:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:28:59 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-31 06:29:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 06:29:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 06:29:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 06:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:29:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:29:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:29:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:29:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:29:59 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-31 06:30:17 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-31 06:30:31 [DEBUG   ] Got command RPT from MCS: ref #329125
2018-10-31 06:30:31 [DEBUG   ] summary = ERROR
2018-10-31 06:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329125  13 58422 23431341 A  ERRORERROR'
2018-10-31 06:30:31 [DEBUG   ] Got command RPT from MCS: ref #329126
2018-10-31 06:30:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329126  77 58422 23431545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:30:31 [DEBUG   ] Got command RPT from MCS: ref #329127
2018-10-31 06:30:31 [DEBUG   ] summary = ERROR
2018-10-31 06:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329127  13 58422 23431749 A  ERRORERROR'
2018-10-31 06:30:31 [DEBUG   ] Got command RPT from MCS: ref #329128
2018-10-31 06:30:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329128  77 58422 23431941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:30:32 [DEBUG   ] Got command RPT from MCS: ref #329129
2018-10-31 06:30:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329129  12 58422 23432145 A  ERRORB'
2018-10-31 06:30:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 06:30:40 [DEBUG   ] Got command RPT from MCS: ref #329130
2018-10-31 06:30:40 [DEBUG   ] summary = ERROR
2018-10-31 06:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329130  13 58422 23440077 A  ERRORERROR'
2018-10-31 06:30:40 [DEBUG   ] Got command RPT from MCS: ref #329131
2018-10-31 06:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329131  77 58422 23440078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:30:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 06:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-10-31 06:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:30:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:30:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:30:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:30:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:30:59 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-31 06:31:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 06:31:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 06:31:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:31:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:31:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:31:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:31:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:31:59 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-31 06:32:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:32:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 06:32:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 06:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:32:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:32:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:32:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:32:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:32:59 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-31 06:33:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:33:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 06:33:58 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-31 06:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:33:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:33:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:33:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:33:59 [WARNING ] (13, 1, 'bot')
2018-10-31 06:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:33:59 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-10-31 06:34:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 06:34:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 06:34:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 06:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:35:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:35:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:35:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:35:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:35:00 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-10-31 06:35:18 [DEBUG   ] Finished updating ant stats in 1.102 seconds
2018-10-31 06:35:31 [DEBUG   ] Got command RPT from MCS: ref #329157
2018-10-31 06:35:31 [DEBUG   ] summary = ERROR
2018-10-31 06:35:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329157  13 58422 23731429 A  ERRORERROR'
2018-10-31 06:35:31 [DEBUG   ] Got command RPT from MCS: ref #329158
2018-10-31 06:35:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:35:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329158  77 58422 23731633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:35:31 [DEBUG   ] Got command RPT from MCS: ref #329159
2018-10-31 06:35:31 [DEBUG   ] summary = ERROR
2018-10-31 06:35:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329159  13 58422 23731837 A  ERRORERROR'
2018-10-31 06:35:32 [DEBUG   ] Got command RPT from MCS: ref #329161
2018-10-31 06:35:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329161  77 58422 23732029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:35:32 [DEBUG   ] Got command RPT from MCS: ref #329162
2018-10-31 06:35:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329162  12 58422 23732233 A  ERRORB'
2018-10-31 06:35:38 [DEBUG   ] Finished updating ant stats in 0.903 seconds
2018-10-31 06:35:40 [DEBUG   ] Got command RPT from MCS: ref #329167
2018-10-31 06:35:40 [DEBUG   ] summary = ERROR
2018-10-31 06:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329167  13 58422 23740081 A  ERRORERROR'
2018-10-31 06:35:40 [DEBUG   ] Got command RPT from MCS: ref #329168
2018-10-31 06:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329168  77 58422 23740082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:35:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 06:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:36:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:36:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:36:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:36:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:36:00 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-31 06:36:18 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-31 06:36:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:36:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:37:00 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-31 06:37:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 06:37:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 06:37:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 06:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:38:00 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-31 06:38:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 06:38:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 06:38:59 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-10-31 06:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:39:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:39:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:39:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:39:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:39:00 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-31 06:39:19 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-31 06:39:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 06:39:59 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-10-31 06:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:40:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:40:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:40:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:40:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:40:00 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-31 06:40:19 [DEBUG   ] Finished updating ant stats in 1.020 seconds
2018-10-31 06:40:31 [DEBUG   ] Got command RPT from MCS: ref #329192
2018-10-31 06:40:31 [DEBUG   ] summary = ERROR
2018-10-31 06:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329192  13 58422 24031517 A  ERRORERROR'
2018-10-31 06:40:31 [DEBUG   ] Got command RPT from MCS: ref #329193
2018-10-31 06:40:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329193  77 58422 24031721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:40:31 [DEBUG   ] Got command RPT from MCS: ref #329194
2018-10-31 06:40:31 [DEBUG   ] summary = ERROR
2018-10-31 06:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329194  13 58422 24031913 A  ERRORERROR'
2018-10-31 06:40:32 [DEBUG   ] Got command RPT from MCS: ref #329195
2018-10-31 06:40:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329195  77 58422 24032117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:40:32 [DEBUG   ] Got command RPT from MCS: ref #329196
2018-10-31 06:40:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329196  12 58422 24032321 A  ERRORB'
2018-10-31 06:40:39 [DEBUG   ] Finished updating ant stats in 0.740 seconds
2018-10-31 06:40:40 [DEBUG   ] Got command RPT from MCS: ref #329197
2018-10-31 06:40:40 [DEBUG   ] summary = ERROR
2018-10-31 06:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329197  13 58422 24040073 A  ERRORERROR'
2018-10-31 06:40:40 [DEBUG   ] Got command RPT from MCS: ref #329198
2018-10-31 06:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329198  77 58422 24040074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:40:59 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-10-31 06:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:41:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:41:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:41:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:41:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:41:00 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-31 06:41:19 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-10-31 06:41:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 06:41:59 [DEBUG   ] Finished updating ant stats in 0.451 seconds
2018-10-31 06:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:42:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:42:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:42:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:42:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:42:00 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-31 06:42:20 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2018-10-31 06:42:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 06:42:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 06:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:43:00 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2018-10-31 06:43:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:43:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:43:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:43:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:43:00 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-10-31 06:43:20 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-10-31 06:43:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 06:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:44:00 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-10-31 06:44:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:44:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:44:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:44:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:44:00 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-31 06:44:20 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-10-31 06:44:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 06:44:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 06:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:45:00 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-10-31 06:45:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:45:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:45:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:45:00 [WARNING ] (13, 1, 'bot')
2018-10-31 06:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:45:00 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-10-31 06:45:20 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-31 06:45:31 [DEBUG   ] Got command RPT from MCS: ref #329220
2018-10-31 06:45:31 [DEBUG   ] summary = ERROR
2018-10-31 06:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329220  13 58422 24331597 A  ERRORERROR'
2018-10-31 06:45:31 [DEBUG   ] Got command RPT from MCS: ref #329221
2018-10-31 06:45:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329221  77 58422 24331801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:45:32 [DEBUG   ] Got command RPT from MCS: ref #329222
2018-10-31 06:45:32 [DEBUG   ] summary = ERROR
2018-10-31 06:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329222  13 58422 24332005 A  ERRORERROR'
2018-10-31 06:45:32 [DEBUG   ] Got command RPT from MCS: ref #329224
2018-10-31 06:45:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329224  77 58422 24332197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:45:32 [DEBUG   ] Got command RPT from MCS: ref #329225
2018-10-31 06:45:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329225  12 58422 24332401 A  ERRORB'
2018-10-31 06:45:40 [DEBUG   ] Got command RPT from MCS: ref #329230
2018-10-31 06:45:40 [DEBUG   ] summary = ERROR
2018-10-31 06:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329230  13 58422 24340082 A  ERRORERROR'
2018-10-31 06:45:40 [DEBUG   ] Got command RPT from MCS: ref #329231
2018-10-31 06:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329231  77 58422 24340083 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:45:41 [DEBUG   ] Finished updating ant stats in 1.267 seconds
2018-10-31 06:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:46:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 06:46:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:46:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:46:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:46:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:46:01 [DEBUG   ] Finished updating board flags in 2.553 seconds
2018-10-31 06:46:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 06:46:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 06:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 06:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:47:01 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-10-31 06:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:47:01 [DEBUG   ] Finished updating board flags in 2.140 seconds
2018-10-31 06:47:21 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-10-31 06:47:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:48:01 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-10-31 06:48:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:48:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:48:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:48:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:48:01 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-31 06:48:21 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-10-31 06:48:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:49:01 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-10-31 06:49:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:49:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:49:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:49:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:49:01 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-31 06:49:21 [DEBUG   ] Finished updating ant stats in 0.561 seconds
2018-10-31 06:49:41 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 06:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:50:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:50:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:50:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:50:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:50:01 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-31 06:50:02 [DEBUG   ] Finished updating ant stats in 1.562 seconds
2018-10-31 06:50:22 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2018-10-31 06:50:31 [DEBUG   ] Got command RPT from MCS: ref #329255
2018-10-31 06:50:31 [DEBUG   ] summary = ERROR
2018-10-31 06:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329255  13 58422 24631681 A  ERRORERROR'
2018-10-31 06:50:31 [DEBUG   ] Got command RPT from MCS: ref #329256
2018-10-31 06:50:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329256  77 58422 24631885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:50:32 [DEBUG   ] Got command RPT from MCS: ref #329257
2018-10-31 06:50:32 [DEBUG   ] summary = ERROR
2018-10-31 06:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329257  13 58422 24632089 A  ERRORERROR'
2018-10-31 06:50:32 [DEBUG   ] Got command RPT from MCS: ref #329258
2018-10-31 06:50:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329258  77 58422 24632293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:50:32 [DEBUG   ] Got command RPT from MCS: ref #329259
2018-10-31 06:50:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329259  12 58422 24632485 A  ERRORB'
2018-10-31 06:50:40 [DEBUG   ] Got command RPT from MCS: ref #329260
2018-10-31 06:50:40 [DEBUG   ] summary = ERROR
2018-10-31 06:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329260  13 58422 24640081 A  ERRORERROR'
2018-10-31 06:50:40 [DEBUG   ] Got command RPT from MCS: ref #329261
2018-10-31 06:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329261  77 58422 24640082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:50:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 06:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:51:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:51:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:51:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:51:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:51:01 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-10-31 06:51:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:51:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:51:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 06:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:52:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:52:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:52:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:52:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:52:01 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-31 06:52:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 06:52:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 06:52:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 06:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:53:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:53:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:53:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:53:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:53:01 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-10-31 06:53:02 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-31 06:53:23 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 06:53:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 06:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:54:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:54:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:54:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:54:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:54:01 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-31 06:54:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 06:54:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 06:54:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 06:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:55:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:55:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:55:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:55:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:55:01 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-31 06:55:03 [DEBUG   ] Finished updating ant stats in 1.367 seconds
2018-10-31 06:55:23 [DEBUG   ] Finished updating ant stats in 0.839 seconds
2018-10-31 06:55:31 [DEBUG   ] Got command RPT from MCS: ref #329287
2018-10-31 06:55:31 [DEBUG   ] summary = ERROR
2018-10-31 06:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329287  13 58422 24931765 A  ERRORERROR'
2018-10-31 06:55:31 [DEBUG   ] Got command RPT from MCS: ref #329288
2018-10-31 06:55:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329288  77 58422 24931969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:55:32 [DEBUG   ] Got command RPT from MCS: ref #329289
2018-10-31 06:55:32 [DEBUG   ] summary = ERROR
2018-10-31 06:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329289  13 58422 24932173 A  ERRORERROR'
2018-10-31 06:55:32 [DEBUG   ] Got command RPT from MCS: ref #329291
2018-10-31 06:55:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329291  77 58422 24932377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:55:32 [DEBUG   ] Got command RPT from MCS: ref #329292
2018-10-31 06:55:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 06:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329292  12 58422 24932569 A  ERRORB'
2018-10-31 06:55:40 [DEBUG   ] Got command RPT from MCS: ref #329297
2018-10-31 06:55:40 [DEBUG   ] summary = ERROR
2018-10-31 06:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329297  13 58422 24940081 A  ERRORERROR'
2018-10-31 06:55:40 [DEBUG   ] Got command RPT from MCS: ref #329298
2018-10-31 06:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 06:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329298  77 58422 24940082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 06:55:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 06:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:56:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:56:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:56:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:56:01 [WARNING ] (13, 1, 'bot')
2018-10-31 06:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:56:01 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-31 06:56:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 06:56:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 06:56:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 06:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:57:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 06:57:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:57:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:57:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:57:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:57:02 [DEBUG   ] Finished updating board flags in 2.081 seconds
2018-10-31 06:57:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 06:57:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 06:57:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 06:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:58:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:58:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:58:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:58:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:58:02 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-31 06:58:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 06:58:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 06:58:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 06:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 06:59:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:59:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:59:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:59:02 [WARNING ] (13, 1, 'bot')
2018-10-31 06:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 06:59:02 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-31 06:59:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-31 06:59:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 06:59:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 07:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:00:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:00:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:00:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:00:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:00:02 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-31 07:00:04 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-10-31 07:00:24 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2018-10-31 07:00:31 [DEBUG   ] Got command RPT from MCS: ref #329318
2018-10-31 07:00:31 [DEBUG   ] summary = ERROR
2018-10-31 07:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329318  13 58422 25231857 A  ERRORERROR'
2018-10-31 07:00:32 [DEBUG   ] Got command RPT from MCS: ref #329319
2018-10-31 07:00:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329319  77 58422 25232061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:00:32 [DEBUG   ] Got command RPT from MCS: ref #329320
2018-10-31 07:00:32 [DEBUG   ] summary = ERROR
2018-10-31 07:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329320  13 58422 25232253 A  ERRORERROR'
2018-10-31 07:00:32 [DEBUG   ] Got command RPT from MCS: ref #329321
2018-10-31 07:00:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329321  77 58422 25232457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:00:32 [DEBUG   ] Got command RPT from MCS: ref #329322
2018-10-31 07:00:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329322  12 58422 25232661 A  ERRORB'
2018-10-31 07:00:40 [DEBUG   ] Got command RPT from MCS: ref #329323
2018-10-31 07:00:40 [DEBUG   ] summary = ERROR
2018-10-31 07:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329323  13 58422 25240089 A  ERRORERROR'
2018-10-31 07:00:40 [DEBUG   ] Got command RPT from MCS: ref #329324
2018-10-31 07:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329324  77 58422 25240090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:00:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 07:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:01:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:01:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:01:02 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-31 07:01:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:01:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:01:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 07:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:02:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:02:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:02:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:02:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:02:02 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-31 07:02:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:02:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 07:02:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 07:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:03:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:03:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:03:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:03:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:03:02 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-10-31 07:03:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:03:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 07:03:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 07:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:04:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:04:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:04:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:04:02 [WARNING ] (13, 1, 'bot')
2018-10-31 07:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:04:02 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-31 07:04:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 07:04:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 07:04:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 07:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:05:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:05:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:05:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:05:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:05:03 [DEBUG   ] Finished updating board flags in 2.226 seconds
2018-10-31 07:05:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 07:05:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 07:05:31 [DEBUG   ] Got command RPT from MCS: ref #329350
2018-10-31 07:05:31 [DEBUG   ] summary = ERROR
2018-10-31 07:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329350  13 58422 25531941 A  ERRORERROR'
2018-10-31 07:05:32 [DEBUG   ] Got command RPT from MCS: ref #329351
2018-10-31 07:05:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329351  77 58422 25532145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:05:32 [DEBUG   ] Got command RPT from MCS: ref #329352
2018-10-31 07:05:32 [DEBUG   ] summary = ERROR
2018-10-31 07:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329352  13 58422 25532349 A  ERRORERROR'
2018-10-31 07:05:32 [DEBUG   ] Got command RPT from MCS: ref #329354
2018-10-31 07:05:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329354  77 58422 25532541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:05:32 [DEBUG   ] Got command RPT from MCS: ref #329355
2018-10-31 07:05:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329355  12 58422 25532745 A  ERRORB'
2018-10-31 07:05:40 [DEBUG   ] Got command RPT from MCS: ref #329360
2018-10-31 07:05:40 [DEBUG   ] summary = ERROR
2018-10-31 07:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329360  13 58422 25540089 A  ERRORERROR'
2018-10-31 07:05:40 [DEBUG   ] Got command RPT from MCS: ref #329361
2018-10-31 07:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329361  77 58422 25540090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:05:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 07:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:06:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:06:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:06:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:06:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:06:03 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-10-31 07:06:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 07:06:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 07:06:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:07:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:07:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:07:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:07:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:07:03 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-10-31 07:07:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:07:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:07:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:08:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:08:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:08:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:08:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:08:03 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-31 07:08:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:08:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 07:08:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:09:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:09:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:09:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:09:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:09:03 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-31 07:09:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 07:09:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:09:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 07:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:10:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:10:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:10:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:10:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:10:03 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-10-31 07:10:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 07:10:25 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-10-31 07:10:32 [DEBUG   ] Got command RPT from MCS: ref #329385
2018-10-31 07:10:32 [DEBUG   ] summary = ERROR
2018-10-31 07:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329385  13 58422 25832029 A  ERRORERROR'
2018-10-31 07:10:32 [DEBUG   ] Got command RPT from MCS: ref #329386
2018-10-31 07:10:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329386  77 58422 25832233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:10:32 [DEBUG   ] Got command RPT from MCS: ref #329387
2018-10-31 07:10:32 [DEBUG   ] summary = ERROR
2018-10-31 07:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329387  13 58422 25832425 A  ERRORERROR'
2018-10-31 07:10:32 [DEBUG   ] Got command RPT from MCS: ref #329388
2018-10-31 07:10:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329388  77 58422 25832629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:10:32 [DEBUG   ] Got command RPT from MCS: ref #329389
2018-10-31 07:10:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329389  12 58422 25832833 A  ERRORB'
2018-10-31 07:10:40 [DEBUG   ] Got command RPT from MCS: ref #329390
2018-10-31 07:10:40 [DEBUG   ] summary = ERROR
2018-10-31 07:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329390  13 58422 25840081 A  ERRORERROR'
2018-10-31 07:10:40 [DEBUG   ] Got command RPT from MCS: ref #329391
2018-10-31 07:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329391  77 58422 25840082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:10:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 07:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:11:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:11:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:11:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:11:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:11:03 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-31 07:11:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 07:11:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 07:11:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 07:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:12:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:12:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:12:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:12:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:12:03 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-31 07:12:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:12:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:12:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 07:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:13:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:13:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:13:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:13:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:13:03 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-10-31 07:13:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 07:13:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:13:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 07:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:14:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:14:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:14:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:14:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:14:03 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-31 07:14:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:14:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 07:14:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:15:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:15:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:15:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:15:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:15:03 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-31 07:15:06 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-10-31 07:15:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-31 07:15:32 [DEBUG   ] Got command RPT from MCS: ref #329413
2018-10-31 07:15:32 [DEBUG   ] summary = ERROR
2018-10-31 07:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329413  13 58422 26132117 A  ERRORERROR'
2018-10-31 07:15:32 [DEBUG   ] Got command RPT from MCS: ref #329414
2018-10-31 07:15:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329414  77 58422 26132309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:15:32 [DEBUG   ] Got command RPT from MCS: ref #329415
2018-10-31 07:15:32 [DEBUG   ] summary = ERROR
2018-10-31 07:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329415  13 58422 26132513 A  ERRORERROR'
2018-10-31 07:15:32 [DEBUG   ] Got command RPT from MCS: ref #329417
2018-10-31 07:15:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329417  77 58422 26132717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:15:32 [DEBUG   ] Got command RPT from MCS: ref #329418
2018-10-31 07:15:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329418  12 58422 26132921 A  ERRORB'
2018-10-31 07:15:40 [DEBUG   ] Got command RPT from MCS: ref #329423
2018-10-31 07:15:40 [DEBUG   ] summary = ERROR
2018-10-31 07:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329423  13 58422 26140085 A  ERRORERROR'
2018-10-31 07:15:40 [DEBUG   ] Got command RPT from MCS: ref #329424
2018-10-31 07:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329424  77 58422 26140086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:15:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 07:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:16:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:16:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:16:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:16:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:16:03 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-31 07:16:07 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-31 07:16:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:16:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:17:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:17:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:17:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:17:03 [WARNING ] (13, 1, 'bot')
2018-10-31 07:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:17:03 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-10-31 07:17:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:17:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 07:17:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:18:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 07:18:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:18:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:18:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:18:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:18:04 [DEBUG   ] Finished updating board flags in 2.076 seconds
2018-10-31 07:18:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 07:18:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:18:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 07:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:19:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:19:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:19:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:19:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:19:04 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-31 07:19:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 07:19:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 07:19:48 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-31 07:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:20:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:20:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:20:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:20:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:20:04 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-10-31 07:20:07 [DEBUG   ] Finished updating ant stats in 0.422 seconds
2018-10-31 07:20:28 [DEBUG   ] Finished updating ant stats in 1.380 seconds
2018-10-31 07:20:32 [DEBUG   ] Got command RPT from MCS: ref #329448
2018-10-31 07:20:32 [DEBUG   ] summary = ERROR
2018-10-31 07:20:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329448  13 58422 26432201 A  ERRORERROR'
2018-10-31 07:20:32 [DEBUG   ] Got command RPT from MCS: ref #329449
2018-10-31 07:20:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:20:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329449  77 58422 26432405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:20:32 [DEBUG   ] Got command RPT from MCS: ref #329450
2018-10-31 07:20:32 [DEBUG   ] summary = ERROR
2018-10-31 07:20:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329450  13 58422 26432597 A  ERRORERROR'
2018-10-31 07:20:32 [DEBUG   ] Got command RPT from MCS: ref #329451
2018-10-31 07:20:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:20:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329451  77 58422 26432801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:20:33 [DEBUG   ] Got command RPT from MCS: ref #329452
2018-10-31 07:20:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329452  12 58422 26433005 A  ERRORB'
2018-10-31 07:20:40 [DEBUG   ] Got command RPT from MCS: ref #329453
2018-10-31 07:20:40 [DEBUG   ] summary = ERROR
2018-10-31 07:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329453  13 58422 26440085 A  ERRORERROR'
2018-10-31 07:20:40 [DEBUG   ] Got command RPT from MCS: ref #329454
2018-10-31 07:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329454  77 58422 26440086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:20:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 07:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:21:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:21:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:21:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:21:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:21:04 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-31 07:21:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 07:21:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:21:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:22:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:22:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:22:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:22:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:22:04 [DEBUG   ] Finished updating board flags in 1.852 seconds
2018-10-31 07:22:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:22:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 07:22:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:23:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:23:04 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-31 07:23:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:23:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 07:23:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 07:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:24:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:24:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:24:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:24:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:24:04 [DEBUG   ] Finished updating board flags in 1.733 seconds
2018-10-31 07:24:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:24:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 07:24:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 07:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:25:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:25:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:25:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:25:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:25:04 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-31 07:25:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 07:25:29 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-31 07:25:32 [DEBUG   ] Got command RPT from MCS: ref #329480
2018-10-31 07:25:32 [DEBUG   ] summary = ERROR
2018-10-31 07:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329480  13 58422 26732285 A  ERRORERROR'
2018-10-31 07:25:32 [DEBUG   ] Got command RPT from MCS: ref #329481
2018-10-31 07:25:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329481  77 58422 26732489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:25:32 [DEBUG   ] Got command RPT from MCS: ref #329482
2018-10-31 07:25:32 [DEBUG   ] summary = ERROR
2018-10-31 07:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329482  13 58422 26732681 A  ERRORERROR'
2018-10-31 07:25:32 [DEBUG   ] Got command RPT from MCS: ref #329484
2018-10-31 07:25:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329484  77 58422 26732885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:25:33 [DEBUG   ] Got command RPT from MCS: ref #329486
2018-10-31 07:25:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329486  12 58422 26733089 A  ERRORB'
2018-10-31 07:25:40 [DEBUG   ] Got command RPT from MCS: ref #329490
2018-10-31 07:25:40 [DEBUG   ] summary = ERROR
2018-10-31 07:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329490  13 58422 26740085 A  ERRORERROR'
2018-10-31 07:25:40 [DEBUG   ] Got command RPT from MCS: ref #329491
2018-10-31 07:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329491  77 58422 26740086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:25:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:26:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:26:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:26:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:26:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:26:04 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-31 07:26:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 07:26:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:26:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 07:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:27:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:27:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:27:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:27:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:27:04 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-31 07:27:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:27:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 07:27:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 07:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:28:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:28:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:28:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:28:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:28:04 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-31 07:28:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 07:28:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 07:28:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:29:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:29:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:29:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:29:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:29:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:29:04 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-31 07:29:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:29:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:29:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 07:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:30:04 [WARNING ] (13, 1, 'bot')
2018-10-31 07:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:30:04 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-10-31 07:30:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:30:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 07:30:32 [DEBUG   ] Got command RPT from MCS: ref #329511
2018-10-31 07:30:32 [DEBUG   ] summary = ERROR
2018-10-31 07:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329511  13 58422 27032373 A  ERRORERROR'
2018-10-31 07:30:32 [DEBUG   ] Got command RPT from MCS: ref #329512
2018-10-31 07:30:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329512  77 58422 27032565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:30:32 [DEBUG   ] Got command RPT from MCS: ref #329513
2018-10-31 07:30:32 [DEBUG   ] summary = ERROR
2018-10-31 07:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329513  13 58422 27032769 A  ERRORERROR'
2018-10-31 07:30:32 [DEBUG   ] Got command RPT from MCS: ref #329514
2018-10-31 07:30:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329514  77 58422 27032973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:30:33 [DEBUG   ] Got command RPT from MCS: ref #329515
2018-10-31 07:30:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329515  12 58422 27033177 A  ERRORB'
2018-10-31 07:30:40 [DEBUG   ] Got command RPT from MCS: ref #329516
2018-10-31 07:30:40 [DEBUG   ] summary = ERROR
2018-10-31 07:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329516  13 58422 27040089 A  ERRORERROR'
2018-10-31 07:30:40 [DEBUG   ] Got command RPT from MCS: ref #329517
2018-10-31 07:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329517  77 58422 27040090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:30:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 07:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:31:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:31:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:31:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:31:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:31:05 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-10-31 07:31:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 07:31:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 07:31:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 07:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:32:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:32:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:32:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:32:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:32:05 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-31 07:32:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 07:32:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 07:32:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 07:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:33:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:33:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:33:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:33:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:33:05 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-31 07:33:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 07:33:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:33:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:34:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:34:05 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-31 07:34:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 07:34:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:34:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:35:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:35:05 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-31 07:35:11 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2018-10-31 07:35:32 [DEBUG   ] Finished updating ant stats in 1.798 seconds
2018-10-31 07:35:32 [DEBUG   ] Got command RPT from MCS: ref #329543
2018-10-31 07:35:32 [DEBUG   ] summary = ERROR
2018-10-31 07:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329543  13 58422 27332453 A  ERRORERROR'
2018-10-31 07:35:32 [DEBUG   ] Got command RPT from MCS: ref #329544
2018-10-31 07:35:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329544  77 58422 27332657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:35:32 [DEBUG   ] Got command RPT from MCS: ref #329545
2018-10-31 07:35:32 [DEBUG   ] summary = ERROR
2018-10-31 07:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329545  13 58422 27332849 A  ERRORERROR'
2018-10-31 07:35:33 [DEBUG   ] Got command RPT from MCS: ref #329547
2018-10-31 07:35:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:35:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329547  77 58422 27333053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:35:33 [DEBUG   ] Got command RPT from MCS: ref #329548
2018-10-31 07:35:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:35:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329548  12 58422 27333257 A  ERRORB'
2018-10-31 07:35:40 [DEBUG   ] Got command RPT from MCS: ref #329553
2018-10-31 07:35:40 [DEBUG   ] summary = ERROR
2018-10-31 07:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329553  13 58422 27340097 A  ERRORERROR'
2018-10-31 07:35:40 [DEBUG   ] Got command RPT from MCS: ref #329554
2018-10-31 07:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329554  77 58422 27340098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:35:51 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 07:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:36:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:36:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:36:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:36:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:36:05 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-10-31 07:36:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 07:36:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 07:36:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-31 07:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:37:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:37:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:37:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:37:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:37:05 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-10-31 07:37:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-31 07:37:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-31 07:37:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:38:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:38:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:38:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:38:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:38:05 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-31 07:38:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 07:38:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:38:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:39:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:39:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:39:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:39:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:39:05 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-10-31 07:39:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 07:39:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 07:39:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:40:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:40:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:40:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:40:05 [WARNING ] (13, 1, 'bot')
2018-10-31 07:40:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:40:05 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-31 07:40:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:40:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:40:32 [DEBUG   ] Got command RPT from MCS: ref #329578
2018-10-31 07:40:32 [DEBUG   ] summary = ERROR
2018-10-31 07:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329578  13 58422 27632541 A  ERRORERROR'
2018-10-31 07:40:32 [DEBUG   ] Got command RPT from MCS: ref #329579
2018-10-31 07:40:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329579  77 58422 27632733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:40:32 [DEBUG   ] Got command RPT from MCS: ref #329580
2018-10-31 07:40:32 [DEBUG   ] summary = ERROR
2018-10-31 07:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329580  13 58422 27632937 A  ERRORERROR'
2018-10-31 07:40:33 [DEBUG   ] Got command RPT from MCS: ref #329581
2018-10-31 07:40:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329581  77 58422 27633141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:40:33 [DEBUG   ] Got command RPT from MCS: ref #329582
2018-10-31 07:40:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329582  12 58422 27633345 A  ERRORB'
2018-10-31 07:40:40 [DEBUG   ] Got command RPT from MCS: ref #329583
2018-10-31 07:40:40 [DEBUG   ] summary = ERROR
2018-10-31 07:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329583  13 58422 27640089 A  ERRORERROR'
2018-10-31 07:40:40 [DEBUG   ] Got command RPT from MCS: ref #329584
2018-10-31 07:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329584  77 58422 27640090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:40:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 07:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:41:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:41:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:41:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:41:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:41:06 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-10-31 07:41:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:41:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 07:41:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 07:42:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-10-31 07:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:42:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:42:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:42:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:42:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:42:06 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-10-31 07:42:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 07:42:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 07:42:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 07:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:43:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:43:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:43:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:43:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:43:06 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-31 07:43:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 07:43:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:43:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:44:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:44:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:44:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:44:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:44:06 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-31 07:44:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:44:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 07:44:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:45:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:45:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:45:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:45:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:45:06 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-31 07:45:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 07:45:32 [DEBUG   ] Got command RPT from MCS: ref #329606
2018-10-31 07:45:32 [DEBUG   ] summary = ERROR
2018-10-31 07:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329606  13 58422 27932617 A  ERRORERROR'
2018-10-31 07:45:32 [DEBUG   ] Got command RPT from MCS: ref #329607
2018-10-31 07:45:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329607  77 58422 27932821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:45:33 [DEBUG   ] Got command RPT from MCS: ref #329608
2018-10-31 07:45:33 [DEBUG   ] summary = ERROR
2018-10-31 07:45:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329608  13 58422 27933025 A  ERRORERROR'
2018-10-31 07:45:33 [DEBUG   ] Got command RPT from MCS: ref #329610
2018-10-31 07:45:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:45:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329610  77 58422 27933229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:45:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 07:45:33 [DEBUG   ] Got command RPT from MCS: ref #329612
2018-10-31 07:45:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:45:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329612  12 58422 27933421 A  ERRORB'
2018-10-31 07:45:40 [DEBUG   ] Got command RPT from MCS: ref #329616
2018-10-31 07:45:40 [DEBUG   ] summary = ERROR
2018-10-31 07:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329616  13 58422 27940093 A  ERRORERROR'
2018-10-31 07:45:40 [DEBUG   ] Got command RPT from MCS: ref #329617
2018-10-31 07:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329617  77 58422 27940094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:45:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 07:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:46:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:46:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:46:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:46:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:46:06 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-31 07:46:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:46:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 07:46:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:47:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:47:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:47:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:47:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:47:06 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-31 07:47:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 07:47:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 07:47:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 07:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:48:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:48:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:48:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:48:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:48:06 [DEBUG   ] Finished updating board flags in 1.640 seconds
2018-10-31 07:48:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 07:48:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 07:48:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 07:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 07:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:49:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:49:06 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-10-31 07:49:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 07:49:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 07:49:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 07:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:50:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:50:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:50:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:50:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:50:06 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-31 07:50:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:50:32 [DEBUG   ] Got command RPT from MCS: ref #329641
2018-10-31 07:50:32 [DEBUG   ] summary = ERROR
2018-10-31 07:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329641  13 58422 28232713 A  ERRORERROR'
2018-10-31 07:50:32 [DEBUG   ] Got command RPT from MCS: ref #329642
2018-10-31 07:50:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329642  77 58422 28232905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:50:33 [DEBUG   ] Got command RPT from MCS: ref #329643
2018-10-31 07:50:33 [DEBUG   ] summary = ERROR
2018-10-31 07:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329643  13 58422 28233109 A  ERRORERROR'
2018-10-31 07:50:33 [DEBUG   ] Got command RPT from MCS: ref #329644
2018-10-31 07:50:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329644  77 58422 28233313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:50:33 [DEBUG   ] Got command RPT from MCS: ref #329645
2018-10-31 07:50:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329645  12 58422 28233505 A  ERRORB'
2018-10-31 07:50:34 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 07:50:40 [DEBUG   ] Got command RPT from MCS: ref #329646
2018-10-31 07:50:40 [DEBUG   ] summary = ERROR
2018-10-31 07:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329646  13 58422 28240093 A  ERRORERROR'
2018-10-31 07:50:40 [DEBUG   ] Got command RPT from MCS: ref #329647
2018-10-31 07:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329647  77 58422 28240094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:50:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 07:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:51:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:51:06 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-31 07:51:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 07:51:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:51:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 07:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:52:06 [WARNING ] (13, 1, 'bot')
2018-10-31 07:52:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:52:06 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-31 07:52:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 07:52:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 07:52:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:53:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:53:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:53:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:53:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:53:07 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-10-31 07:53:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 07:53:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 07:53:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 07:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:54:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:54:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:54:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:54:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:54:07 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-31 07:54:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 07:54:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 07:54:54 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-31 07:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:55:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:55:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:55:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:55:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:55:07 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-31 07:55:14 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 07:55:32 [DEBUG   ] Got command RPT from MCS: ref #329673
2018-10-31 07:55:32 [DEBUG   ] summary = ERROR
2018-10-31 07:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329673  13 58422 28532789 A  ERRORERROR'
2018-10-31 07:55:32 [DEBUG   ] Got command RPT from MCS: ref #329674
2018-10-31 07:55:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329674  77 58422 28532993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:55:33 [DEBUG   ] Got command RPT from MCS: ref #329675
2018-10-31 07:55:33 [DEBUG   ] summary = ERROR
2018-10-31 07:55:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329675  13 58422 28533197 A  ERRORERROR'
2018-10-31 07:55:33 [DEBUG   ] Got command RPT from MCS: ref #329677
2018-10-31 07:55:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:55:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329677  77 58422 28533401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:55:33 [DEBUG   ] Got command RPT from MCS: ref #329678
2018-10-31 07:55:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 07:55:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329678  12 58422 28533593 A  ERRORB'
2018-10-31 07:55:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 07:55:40 [DEBUG   ] Got command RPT from MCS: ref #329683
2018-10-31 07:55:40 [DEBUG   ] summary = ERROR
2018-10-31 07:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329683  13 58422 28540097 A  ERRORERROR'
2018-10-31 07:55:40 [DEBUG   ] Got command RPT from MCS: ref #329684
2018-10-31 07:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 07:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329684  77 58422 28540098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 07:55:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 07:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 07:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:56:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:56:07 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-31 07:56:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:56:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 07:56:55 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-31 07:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:57:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:57:07 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-31 07:57:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 07:57:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 07:57:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 07:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:58:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:58:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:58:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:58:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:58:07 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-31 07:58:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 07:58:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 07:58:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 07:59:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:59:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:59:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:59:07 [WARNING ] (13, 1, 'bot')
2018-10-31 07:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 07:59:07 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-31 07:59:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 07:59:35 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 07:59:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 08:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:00:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:00:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:00:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:00:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:00:07 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-31 08:00:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 08:00:32 [DEBUG   ] Got command RPT from MCS: ref #329704
2018-10-31 08:00:32 [DEBUG   ] summary = ERROR
2018-10-31 08:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329704  13 58422 28832885 A  ERRORERROR'
2018-10-31 08:00:33 [DEBUG   ] Got command RPT from MCS: ref #329705
2018-10-31 08:00:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329705  77 58422 28833077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:00:33 [DEBUG   ] Got command RPT from MCS: ref #329706
2018-10-31 08:00:33 [DEBUG   ] summary = ERROR
2018-10-31 08:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329706  13 58422 28833281 A  ERRORERROR'
2018-10-31 08:00:33 [DEBUG   ] Got command RPT from MCS: ref #329707
2018-10-31 08:00:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329707  77 58422 28833485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:00:33 [DEBUG   ] Got command RPT from MCS: ref #329708
2018-10-31 08:00:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329708  12 58422 28833677 A  ERRORB'
2018-10-31 08:00:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 08:00:40 [DEBUG   ] Got command RPT from MCS: ref #329709
2018-10-31 08:00:40 [DEBUG   ] summary = ERROR
2018-10-31 08:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329709  13 58422 28840097 A  ERRORERROR'
2018-10-31 08:00:40 [DEBUG   ] Got command RPT from MCS: ref #329710
2018-10-31 08:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329710  77 58422 28840098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:00:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 08:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:01:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:01:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:01:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:01:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:01:07 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-31 08:01:15 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 08:01:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:01:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 08:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:02:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:02:07 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-31 08:02:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 08:02:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:02:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 08:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:03:07 [WARNING ] (13, 1, 'bot')
2018-10-31 08:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:03:07 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-10-31 08:03:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 08:03:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:03:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 08:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:04:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:04:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:04:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:04:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:04:08 [DEBUG   ] Finished updating board flags in 2.069 seconds
2018-10-31 08:04:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 08:04:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 08:04:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 08:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:05:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:05:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:05:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:05:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:05:08 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-31 08:05:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 08:05:32 [DEBUG   ] Got command RPT from MCS: ref #329736
2018-10-31 08:05:32 [DEBUG   ] summary = ERROR
2018-10-31 08:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329736  13 58422 29132961 A  ERRORERROR'
2018-10-31 08:05:33 [DEBUG   ] Got command RPT from MCS: ref #329737
2018-10-31 08:05:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:05:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329737  77 58422 29133165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:05:33 [DEBUG   ] Got command RPT from MCS: ref #329738
2018-10-31 08:05:33 [DEBUG   ] summary = ERROR
2018-10-31 08:05:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329738  13 58422 29133369 A  ERRORERROR'
2018-10-31 08:05:33 [DEBUG   ] Got command RPT from MCS: ref #329740
2018-10-31 08:05:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:05:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329740  77 58422 29133573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:05:33 [DEBUG   ] Got command RPT from MCS: ref #329742
2018-10-31 08:05:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:05:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329742  12 58422 29133765 A  ERRORB'
2018-10-31 08:05:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 08:05:40 [DEBUG   ] Got command RPT from MCS: ref #329746
2018-10-31 08:05:40 [DEBUG   ] summary = ERROR
2018-10-31 08:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329746  13 58422 29140093 A  ERRORERROR'
2018-10-31 08:05:40 [DEBUG   ] Got command RPT from MCS: ref #329747
2018-10-31 08:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329747  77 58422 29140094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:05:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 08:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:06:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:06:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:06:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:06:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:06:08 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-31 08:06:17 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-31 08:06:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:06:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 08:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:07:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:07:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:07:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:07:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:07:08 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-31 08:07:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 08:07:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:07:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:08:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:08:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:08:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:08:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:08:08 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-31 08:08:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 08:08:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 08:08:58 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-31 08:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:09:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:09:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:09:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:09:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:09:08 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-31 08:09:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 08:09:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 08:09:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:10:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:10:08 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-31 08:10:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 08:10:33 [DEBUG   ] Got command RPT from MCS: ref #329771
2018-10-31 08:10:33 [DEBUG   ] summary = ERROR
2018-10-31 08:10:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329771  13 58422 29433049 A  ERRORERROR'
2018-10-31 08:10:33 [DEBUG   ] Got command RPT from MCS: ref #329772
2018-10-31 08:10:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:10:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329772  77 58422 29433253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:10:33 [DEBUG   ] Got command RPT from MCS: ref #329773
2018-10-31 08:10:33 [DEBUG   ] summary = ERROR
2018-10-31 08:10:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329773  13 58422 29433457 A  ERRORERROR'
2018-10-31 08:10:33 [DEBUG   ] Got command RPT from MCS: ref #329774
2018-10-31 08:10:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:10:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329774  77 58422 29433649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:10:33 [DEBUG   ] Got command RPT from MCS: ref #329775
2018-10-31 08:10:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:10:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329775  12 58422 29433853 A  ERRORB'
2018-10-31 08:10:38 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-31 08:10:40 [DEBUG   ] Got command RPT from MCS: ref #329776
2018-10-31 08:10:40 [DEBUG   ] summary = ERROR
2018-10-31 08:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329776  13 58422 29440105 A  ERRORERROR'
2018-10-31 08:10:40 [DEBUG   ] Got command RPT from MCS: ref #329777
2018-10-31 08:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329777  77 58422 29440106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:10:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 08:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:11:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:11:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:11:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:11:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:11:08 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-31 08:11:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 08:11:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:11:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 08:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:12:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:12:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:12:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:12:08 [WARNING ] (13, 1, 'bot')
2018-10-31 08:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:12:08 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-10-31 08:12:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 08:12:39 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-31 08:12:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 08:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 08:13:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:13:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:13:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:13:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:13:09 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-31 08:13:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 08:13:38 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 08:13:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 08:14:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:14:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:14:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:14:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:14:09 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-31 08:14:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 08:14:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 08:14:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:15:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:15:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:15:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:15:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:15:09 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-31 08:15:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 08:15:33 [DEBUG   ] Got command RPT from MCS: ref #329799
2018-10-31 08:15:33 [DEBUG   ] summary = ERROR
2018-10-31 08:15:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329799  13 58422 29733141 A  ERRORERROR'
2018-10-31 08:15:33 [DEBUG   ] Got command RPT from MCS: ref #329800
2018-10-31 08:15:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:15:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329800  77 58422 29733333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:15:33 [DEBUG   ] Got command RPT from MCS: ref #329801
2018-10-31 08:15:33 [DEBUG   ] summary = ERROR
2018-10-31 08:15:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329801  13 58422 29733537 A  ERRORERROR'
2018-10-31 08:15:33 [DEBUG   ] Got command RPT from MCS: ref #329803
2018-10-31 08:15:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:15:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329803  77 58422 29733741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:15:33 [DEBUG   ] Got command RPT from MCS: ref #329804
2018-10-31 08:15:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:15:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329804  12 58422 29733945 A  ERRORB'
2018-10-31 08:15:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:15:40 [DEBUG   ] Got command RPT from MCS: ref #329809
2018-10-31 08:15:40 [DEBUG   ] summary = ERROR
2018-10-31 08:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329809  13 58422 29740101 A  ERRORERROR'
2018-10-31 08:15:40 [DEBUG   ] Got command RPT from MCS: ref #329810
2018-10-31 08:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329810  77 58422 29740102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:15:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:16:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:16:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:16:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:16:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:16:09 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-31 08:16:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 08:16:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 08:16:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:17:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:17:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:17:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:17:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:17:09 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-31 08:17:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 08:17:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 08:18:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 08:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:18:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:18:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:18:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:18:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:18:09 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-31 08:18:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 08:18:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 08:18:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 08:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:19:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:19:09 [DEBUG   ] Finished updating board flags in 1.684 seconds
2018-10-31 08:19:19 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-31 08:19:39 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 08:20:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 08:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 08:20:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:20:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:20:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:20:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:20:09 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-31 08:20:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:20:33 [DEBUG   ] Got command RPT from MCS: ref #329834
2018-10-31 08:20:33 [DEBUG   ] summary = ERROR
2018-10-31 08:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329834  13 58422 30033225 A  ERRORERROR'
2018-10-31 08:20:33 [DEBUG   ] Got command RPT from MCS: ref #329835
2018-10-31 08:20:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329835  77 58422 30033429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:20:33 [DEBUG   ] Got command RPT from MCS: ref #329836
2018-10-31 08:20:33 [DEBUG   ] summary = ERROR
2018-10-31 08:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329836  13 58422 30033621 A  ERRORERROR'
2018-10-31 08:20:33 [DEBUG   ] Got command RPT from MCS: ref #329837
2018-10-31 08:20:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329837  77 58422 30033825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:20:34 [DEBUG   ] Got command RPT from MCS: ref #329838
2018-10-31 08:20:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329838  12 58422 30034029 A  ERRORB'
2018-10-31 08:20:40 [DEBUG   ] Got command RPT from MCS: ref #329839
2018-10-31 08:20:40 [DEBUG   ] summary = ERROR
2018-10-31 08:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329839  13 58422 30040101 A  ERRORERROR'
2018-10-31 08:20:40 [DEBUG   ] Got command RPT from MCS: ref #329840
2018-10-31 08:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329840  77 58422 30040102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:20:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 08:21:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:21:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:21:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:21:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:21:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:21:09 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-10-31 08:21:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:21:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 08:22:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 08:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:22:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:22:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:22:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:22:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:22:09 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-10-31 08:22:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:22:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:23:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 08:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:23:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:23:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:23:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:23:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:23:09 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-31 08:23:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:23:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:24:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 08:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:24:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:24:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:24:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:24:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:24:09 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-10-31 08:24:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 08:24:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 08:25:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 08:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:25:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:25:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:25:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:25:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:25:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:25:09 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-10-31 08:25:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 08:25:33 [DEBUG   ] Got command RPT from MCS: ref #329866
2018-10-31 08:25:33 [DEBUG   ] summary = ERROR
2018-10-31 08:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329866  13 58422 30333309 A  ERRORERROR'
2018-10-31 08:25:33 [DEBUG   ] Got command RPT from MCS: ref #329867
2018-10-31 08:25:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329867  77 58422 30333501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:25:33 [DEBUG   ] Got command RPT from MCS: ref #329868
2018-10-31 08:25:33 [DEBUG   ] summary = ERROR
2018-10-31 08:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329868  13 58422 30333706 A  ERRORERROR'
2018-10-31 08:25:33 [DEBUG   ] Got command RPT from MCS: ref #329870
2018-10-31 08:25:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329870  77 58422 30333909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:25:34 [DEBUG   ] Got command RPT from MCS: ref #329872
2018-10-31 08:25:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:25:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329872  12 58422 30334113 A  ERRORB'
2018-10-31 08:25:40 [DEBUG   ] Got command RPT from MCS: ref #329876
2018-10-31 08:25:40 [DEBUG   ] summary = ERROR
2018-10-31 08:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329876  13 58422 30340101 A  ERRORERROR'
2018-10-31 08:25:40 [DEBUG   ] Got command RPT from MCS: ref #329877
2018-10-31 08:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329877  77 58422 30340102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:25:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 08:26:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:26:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:26:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:26:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:26:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:26:09 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-31 08:26:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 08:26:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:27:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:27:09 [WARNING ] (13, 1, 'bot')
2018-10-31 08:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:27:09 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-10-31 08:27:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:27:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:28:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-31 08:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:28:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:28:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:28:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:28:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:28:10 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-10-31 08:28:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 08:28:41 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 08:29:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:29:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:29:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:29:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:29:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:29:10 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-31 08:29:22 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-31 08:29:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:30:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 08:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:30:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:30:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:30:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:30:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:30:10 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-31 08:30:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 08:30:33 [DEBUG   ] Got command RPT from MCS: ref #329897
2018-10-31 08:30:33 [DEBUG   ] summary = ERROR
2018-10-31 08:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329897  13 58422 30633389 A  ERRORERROR'
2018-10-31 08:30:33 [DEBUG   ] Got command RPT from MCS: ref #329898
2018-10-31 08:30:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329898  77 58422 30633593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:30:33 [DEBUG   ] Got command RPT from MCS: ref #329899
2018-10-31 08:30:33 [DEBUG   ] summary = ERROR
2018-10-31 08:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329899  13 58422 30633797 A  ERRORERROR'
2018-10-31 08:30:33 [DEBUG   ] Got command RPT from MCS: ref #329900
2018-10-31 08:30:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329900  77 58422 30633989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:30:34 [DEBUG   ] Got command RPT from MCS: ref #329901
2018-10-31 08:30:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329901  12 58422 30634193 A  ERRORB'
2018-10-31 08:30:40 [DEBUG   ] Got command RPT from MCS: ref #329902
2018-10-31 08:30:40 [DEBUG   ] summary = ERROR
2018-10-31 08:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329902  13 58422 30640109 A  ERRORERROR'
2018-10-31 08:30:40 [DEBUG   ] Got command RPT from MCS: ref #329903
2018-10-31 08:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329903  77 58422 30640110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:30:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:31:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:31:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:31:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:31:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:31:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:31:10 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-31 08:31:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 08:31:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 08:32:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:32:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:32:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:32:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:32:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:32:10 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-31 08:32:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:32:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:33:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 08:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:33:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:33:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:33:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:33:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:33:10 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-31 08:33:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 08:33:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 08:34:02 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-31 08:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:34:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 08:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:34:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:34:10 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-31 08:34:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-31 08:34:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 08:35:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 08:35:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:35:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:35:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:35:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:35:10 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-10-31 08:35:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 08:35:33 [DEBUG   ] Got command RPT from MCS: ref #329929
2018-10-31 08:35:33 [DEBUG   ] summary = ERROR
2018-10-31 08:35:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329929  13 58422 30933469 A  ERRORERROR'
2018-10-31 08:35:33 [DEBUG   ] Got command RPT from MCS: ref #329930
2018-10-31 08:35:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:35:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329930  77 58422 30933673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:35:33 [DEBUG   ] Got command RPT from MCS: ref #329931
2018-10-31 08:35:33 [DEBUG   ] summary = ERROR
2018-10-31 08:35:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329931  13 58422 30933877 A  ERRORERROR'
2018-10-31 08:35:34 [DEBUG   ] Got command RPT from MCS: ref #329933
2018-10-31 08:35:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329933  77 58422 30934081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:35:34 [DEBUG   ] Got command RPT from MCS: ref #329934
2018-10-31 08:35:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329934  12 58422 30934273 A  ERRORB'
2018-10-31 08:35:40 [DEBUG   ] Got command RPT from MCS: ref #329939
2018-10-31 08:35:40 [DEBUG   ] summary = ERROR
2018-10-31 08:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329939  13 58422 30940105 A  ERRORERROR'
2018-10-31 08:35:40 [DEBUG   ] Got command RPT from MCS: ref #329940
2018-10-31 08:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329940  77 58422 30940106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:35:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 08:36:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 08:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:36:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:36:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:36:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:36:10 [WARNING ] (13, 1, 'bot')
2018-10-31 08:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:36:10 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-31 08:36:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 08:36:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:37:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:37:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 08:37:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:37:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:37:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:37:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:37:11 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-10-31 08:37:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:37:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 08:38:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:38:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:38:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:38:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:38:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:38:11 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-10-31 08:38:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 08:38:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 08:39:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 08:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:39:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:39:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:39:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:39:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:39:11 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-31 08:39:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 08:39:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 08:40:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:40:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 08:40:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:40:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:40:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:40:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:40:11 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-10-31 08:40:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 08:40:33 [DEBUG   ] Got command RPT from MCS: ref #329964
2018-10-31 08:40:33 [DEBUG   ] summary = ERROR
2018-10-31 08:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329964  13 58422 31233557 A  ERRORERROR'
2018-10-31 08:40:33 [DEBUG   ] Got command RPT from MCS: ref #329965
2018-10-31 08:40:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329965  77 58422 31233761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:40:33 [DEBUG   ] Got command RPT from MCS: ref #329966
2018-10-31 08:40:33 [DEBUG   ] summary = ERROR
2018-10-31 08:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329966  13 58422 31233965 A  ERRORERROR'
2018-10-31 08:40:34 [DEBUG   ] Got command RPT from MCS: ref #329967
2018-10-31 08:40:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329967  77 58422 31234158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:40:34 [DEBUG   ] Got command RPT from MCS: ref #329968
2018-10-31 08:40:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329968  12 58422 31234361 A  ERRORB'
2018-10-31 08:40:40 [DEBUG   ] Got command RPT from MCS: ref #329969
2018-10-31 08:40:40 [DEBUG   ] summary = ERROR
2018-10-31 08:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329969  13 58422 31240109 A  ERRORERROR'
2018-10-31 08:40:40 [DEBUG   ] Got command RPT from MCS: ref #329970
2018-10-31 08:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329970  77 58422 31240110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:40:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:41:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:41:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:41:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:41:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:41:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:41:11 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-31 08:41:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 08:41:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 08:42:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:42:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:42:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:42:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:42:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:42:11 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-31 08:42:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 08:42:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:43:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:43:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:43:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:43:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:43:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:43:11 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-10-31 08:43:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 08:43:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:44:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 08:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:44:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:44:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:44:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:44:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:44:11 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-31 08:44:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 08:44:45 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 08:45:05 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-31 08:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:45:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:45:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:45:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:45:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:45:11 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-31 08:45:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 08:45:33 [DEBUG   ] Got command RPT from MCS: ref #329992
2018-10-31 08:45:33 [DEBUG   ] summary = ERROR
2018-10-31 08:45:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329992  13 58422 31533645 A  ERRORERROR'
2018-10-31 08:45:33 [DEBUG   ] Got command RPT from MCS: ref #329993
2018-10-31 08:45:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:45:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329993  77 58422 31533849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:45:34 [DEBUG   ] Got command RPT from MCS: ref #329994
2018-10-31 08:45:34 [DEBUG   ] summary = ERROR
2018-10-31 08:45:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329994  13 58422 31534041 A  ERRORERROR'
2018-10-31 08:45:34 [DEBUG   ] Got command RPT from MCS: ref #329996
2018-10-31 08:45:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:45:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329996  77 58422 31534245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:45:34 [DEBUG   ] Got command RPT from MCS: ref #329997
2018-10-31 08:45:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:45:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   329997  12 58422 31534449 A  ERRORB'
2018-10-31 08:45:40 [DEBUG   ] Got command RPT from MCS: ref #330002
2018-10-31 08:45:40 [DEBUG   ] summary = ERROR
2018-10-31 08:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330002  13 58422 31540105 A  ERRORERROR'
2018-10-31 08:45:40 [DEBUG   ] Got command RPT from MCS: ref #330003
2018-10-31 08:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330003  77 58422 31540106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:45:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:46:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 08:46:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:46:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:46:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:46:11 [WARNING ] (13, 1, 'bot')
2018-10-31 08:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:46:11 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-31 08:46:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 08:46:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 08:47:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:47:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:47:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:47:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:47:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:47:12 [DEBUG   ] Finished updating board flags in 2.193 seconds
2018-10-31 08:47:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:47:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 08:48:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:48:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:48:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:48:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:48:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:48:12 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-10-31 08:48:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:48:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 08:49:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 08:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:49:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:49:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:49:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:49:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:49:12 [DEBUG   ] Finished updating board flags in 1.902 seconds
2018-10-31 08:49:25 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-31 08:49:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-31 08:50:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 08:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:50:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:50:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:50:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:50:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:50:12 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-31 08:50:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 08:50:33 [DEBUG   ] Got command RPT from MCS: ref #330027
2018-10-31 08:50:33 [DEBUG   ] summary = ERROR
2018-10-31 08:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330027  13 58422 31833729 A  ERRORERROR'
2018-10-31 08:50:33 [DEBUG   ] Got command RPT from MCS: ref #330028
2018-10-31 08:50:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330028  77 58422 31833933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:50:34 [DEBUG   ] Got command RPT from MCS: ref #330029
2018-10-31 08:50:34 [DEBUG   ] summary = ERROR
2018-10-31 08:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330029  13 58422 31834125 A  ERRORERROR'
2018-10-31 08:50:34 [DEBUG   ] Got command RPT from MCS: ref #330030
2018-10-31 08:50:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330030  77 58422 31834329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:50:34 [DEBUG   ] Got command RPT from MCS: ref #330031
2018-10-31 08:50:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330031  12 58422 31834533 A  ERRORB'
2018-10-31 08:50:40 [DEBUG   ] Got command RPT from MCS: ref #330032
2018-10-31 08:50:40 [DEBUG   ] summary = ERROR
2018-10-31 08:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330032  13 58422 31840105 A  ERRORERROR'
2018-10-31 08:50:40 [DEBUG   ] Got command RPT from MCS: ref #330033
2018-10-31 08:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330033  77 58422 31840106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:50:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:51:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 08:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:51:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 08:51:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:51:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:51:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:51:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:51:12 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-31 08:51:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 08:51:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:52:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 08:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:52:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:52:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:52:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:52:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:52:12 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-31 08:52:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 08:52:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 08:53:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:53:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:53:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:53:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:53:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:53:12 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-31 08:53:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 08:53:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 08:54:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 08:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 08:54:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:54:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:54:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:54:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:54:12 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-31 08:54:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 08:54:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 08:55:06 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-31 08:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:55:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:55:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:55:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:55:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:55:12 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-10-31 08:55:27 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-31 08:55:33 [DEBUG   ] Got command RPT from MCS: ref #330059
2018-10-31 08:55:33 [DEBUG   ] summary = ERROR
2018-10-31 08:55:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330059  13 58422 32133813 A  ERRORERROR'
2018-10-31 08:55:34 [DEBUG   ] Got command RPT from MCS: ref #330060
2018-10-31 08:55:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330060  77 58422 32134017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:55:34 [DEBUG   ] Got command RPT from MCS: ref #330061
2018-10-31 08:55:34 [DEBUG   ] summary = ERROR
2018-10-31 08:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330061  13 58422 32134221 A  ERRORERROR'
2018-10-31 08:55:34 [DEBUG   ] Got command RPT from MCS: ref #330063
2018-10-31 08:55:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330063  77 58422 32134413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:55:34 [DEBUG   ] Got command RPT from MCS: ref #330064
2018-10-31 08:55:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 08:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330064  12 58422 32134617 A  ERRORB'
2018-10-31 08:55:40 [DEBUG   ] Got command RPT from MCS: ref #330069
2018-10-31 08:55:40 [DEBUG   ] summary = ERROR
2018-10-31 08:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330069  13 58422 32140113 A  ERRORERROR'
2018-10-31 08:55:40 [DEBUG   ] Got command RPT from MCS: ref #330070
2018-10-31 08:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 08:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330070  77 58422 32140114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 08:55:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 08:56:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 08:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:56:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:56:12 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-31 08:56:27 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-31 08:56:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:57:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 08:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:57:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:57:12 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-31 08:57:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 08:57:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 08:58:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 08:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:58:12 [WARNING ] (13, 1, 'bot')
2018-10-31 08:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:58:12 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-31 08:58:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 08:58:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 08:59:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 08:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 08:59:13 [WARNING ] (13, 1, 'bot')
2018-10-31 08:59:13 [WARNING ] (13, 1, 'bot')
2018-10-31 08:59:13 [WARNING ] (13, 1, 'bot')
2018-10-31 08:59:13 [WARNING ] (13, 1, 'bot')
2018-10-31 08:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 08:59:13 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-31 08:59:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 08:59:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 09:00:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 09:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:00:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:00:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:00:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:00:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:00:13 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-31 09:00:27 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-31 09:00:33 [DEBUG   ] Got command RPT from MCS: ref #330090
2018-10-31 09:00:33 [DEBUG   ] summary = ERROR
2018-10-31 09:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330090  13 58422 32433897 A  ERRORERROR'
2018-10-31 09:00:34 [DEBUG   ] Got command RPT from MCS: ref #330091
2018-10-31 09:00:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330091  77 58422 32434101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:00:34 [DEBUG   ] Got command RPT from MCS: ref #330092
2018-10-31 09:00:34 [DEBUG   ] summary = ERROR
2018-10-31 09:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330092  13 58422 32434305 A  ERRORERROR'
2018-10-31 09:00:34 [DEBUG   ] Got command RPT from MCS: ref #330093
2018-10-31 09:00:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330093  77 58422 32434497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:00:34 [DEBUG   ] Got command RPT from MCS: ref #330094
2018-10-31 09:00:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330094  12 58422 32434701 A  ERRORB'
2018-10-31 09:00:40 [DEBUG   ] Got command RPT from MCS: ref #330095
2018-10-31 09:00:40 [DEBUG   ] summary = ERROR
2018-10-31 09:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330095  13 58422 32440113 A  ERRORERROR'
2018-10-31 09:00:40 [DEBUG   ] Got command RPT from MCS: ref #330096
2018-10-31 09:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330096  77 58422 32440114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:00:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 09:01:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:01:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:01:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:01:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:01:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:01:13 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-31 09:01:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 09:01:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:02:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:02:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:02:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:02:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:02:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:02:13 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-31 09:02:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 09:02:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 09:03:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:03:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:03:13 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-31 09:03:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:03:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 09:04:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 09:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:04:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:04:13 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-31 09:04:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 09:04:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:05:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 09:05:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 09:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:05:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:05:13 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-31 09:05:28 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-31 09:05:33 [DEBUG   ] Got command RPT from MCS: ref #330122
2018-10-31 09:05:33 [DEBUG   ] summary = ERROR
2018-10-31 09:05:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330122  13 58422 32733981 A  ERRORERROR'
2018-10-31 09:05:34 [DEBUG   ] Got command RPT from MCS: ref #330123
2018-10-31 09:05:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:05:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330123  77 58422 32734185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:05:34 [DEBUG   ] Got command RPT from MCS: ref #330124
2018-10-31 09:05:34 [DEBUG   ] summary = ERROR
2018-10-31 09:05:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330124  13 58422 32734389 A  ERRORERROR'
2018-10-31 09:05:34 [DEBUG   ] Got command RPT from MCS: ref #330125
2018-10-31 09:05:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:05:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330125  77 58422 32734581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:05:34 [DEBUG   ] Got command RPT from MCS: ref #330127
2018-10-31 09:05:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:05:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330127  12 58422 32734785 A  ERRORB'
2018-10-31 09:05:40 [DEBUG   ] Got command RPT from MCS: ref #330132
2018-10-31 09:05:40 [DEBUG   ] summary = ERROR
2018-10-31 09:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330132  13 58422 32740113 A  ERRORERROR'
2018-10-31 09:05:40 [DEBUG   ] Got command RPT from MCS: ref #330133
2018-10-31 09:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330133  77 58422 32740114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:05:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:06:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 09:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 09:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:06:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:06:13 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-31 09:06:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 09:06:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 09:07:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:07:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:07:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:07:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:07:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:07:13 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-31 09:07:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 09:07:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 09:08:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 09:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 09:08:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:08:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:08:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:08:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:08:13 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-31 09:08:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 09:08:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 09:09:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 09:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:09:13 [WARNING ] (13, 1, 'bot')
2018-10-31 09:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:09:13 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-10-31 09:09:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:09:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 09:10:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 09:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 09:10:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:10:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:10:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:10:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:10:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:10:14 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-31 09:10:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 09:10:34 [DEBUG   ] Got command RPT from MCS: ref #330157
2018-10-31 09:10:34 [DEBUG   ] summary = ERROR
2018-10-31 09:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330157  13 58422 33034073 A  ERRORERROR'
2018-10-31 09:10:34 [DEBUG   ] Got command RPT from MCS: ref #330158
2018-10-31 09:10:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330158  77 58422 33034265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:10:34 [DEBUG   ] Got command RPT from MCS: ref #330159
2018-10-31 09:10:34 [DEBUG   ] summary = ERROR
2018-10-31 09:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330159  13 58422 33034469 A  ERRORERROR'
2018-10-31 09:10:34 [DEBUG   ] Got command RPT from MCS: ref #330160
2018-10-31 09:10:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330160  77 58422 33034673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:10:34 [DEBUG   ] Got command RPT from MCS: ref #330161
2018-10-31 09:10:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330161  12 58422 33034865 A  ERRORB'
2018-10-31 09:10:40 [DEBUG   ] Got command RPT from MCS: ref #330162
2018-10-31 09:10:40 [DEBUG   ] summary = ERROR
2018-10-31 09:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330162  13 58422 33040113 A  ERRORERROR'
2018-10-31 09:10:40 [DEBUG   ] Got command RPT from MCS: ref #330163
2018-10-31 09:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330163  77 58422 33040114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:10:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 09:11:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:11:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:11:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:11:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:11:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:11:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:11:14 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-31 09:11:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 09:11:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 09:12:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:12:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:12:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:12:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:12:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:12:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:12:14 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-10-31 09:12:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 09:12:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 09:13:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:13:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:13:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:13:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:13:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:13:14 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-31 09:13:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 09:13:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 09:14:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 09:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:14:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:14:14 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-31 09:14:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:14:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 09:15:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 09:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 09:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:15:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:15:14 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-31 09:15:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 09:15:34 [DEBUG   ] Got command RPT from MCS: ref #330185
2018-10-31 09:15:34 [DEBUG   ] summary = ERROR
2018-10-31 09:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330185  13 58422 33334149 A  ERRORERROR'
2018-10-31 09:15:34 [DEBUG   ] Got command RPT from MCS: ref #330186
2018-10-31 09:15:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330186  77 58422 33334353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:15:34 [DEBUG   ] Got command RPT from MCS: ref #330187
2018-10-31 09:15:34 [DEBUG   ] summary = ERROR
2018-10-31 09:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330187  13 58422 33334557 A  ERRORERROR'
2018-10-31 09:15:34 [DEBUG   ] Got command RPT from MCS: ref #330189
2018-10-31 09:15:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330189  77 58422 33334749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:15:34 [DEBUG   ] Got command RPT from MCS: ref #330190
2018-10-31 09:15:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330190  12 58422 33334953 A  ERRORB'
2018-10-31 09:15:40 [DEBUG   ] Got command RPT from MCS: ref #330195
2018-10-31 09:15:40 [DEBUG   ] summary = ERROR
2018-10-31 09:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330195  13 58422 33340113 A  ERRORERROR'
2018-10-31 09:15:40 [DEBUG   ] Got command RPT from MCS: ref #330196
2018-10-31 09:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330196  77 58422 33340114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:15:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:16:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 09:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:16:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:16:14 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-31 09:16:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 09:16:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 09:17:11 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-31 09:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:17:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:17:14 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-31 09:17:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 09:17:50 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-31 09:18:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-31 09:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:18:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:18:14 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-31 09:18:31 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-31 09:18:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 09:19:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:19:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:19:14 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-31 09:19:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:19:51 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-31 09:20:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 09:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:20:14 [WARNING ] (13, 1, 'bot')
2018-10-31 09:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:20:14 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-31 09:20:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:20:34 [DEBUG   ] Got command RPT from MCS: ref #330220
2018-10-31 09:20:34 [DEBUG   ] summary = ERROR
2018-10-31 09:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330220  13 58422 33634237 A  ERRORERROR'
2018-10-31 09:20:34 [DEBUG   ] Got command RPT from MCS: ref #330221
2018-10-31 09:20:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330221  77 58422 33634441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:20:34 [DEBUG   ] Got command RPT from MCS: ref #330222
2018-10-31 09:20:34 [DEBUG   ] summary = ERROR
2018-10-31 09:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330222  13 58422 33634633 A  ERRORERROR'
2018-10-31 09:20:34 [DEBUG   ] Got command RPT from MCS: ref #330223
2018-10-31 09:20:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330223  77 58422 33634837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:20:35 [DEBUG   ] Got command RPT from MCS: ref #330224
2018-10-31 09:20:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330224  12 58422 33635041 A  ERRORB'
2018-10-31 09:20:40 [DEBUG   ] Got command RPT from MCS: ref #330225
2018-10-31 09:20:40 [DEBUG   ] summary = ERROR
2018-10-31 09:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330225  13 58422 33640117 A  ERRORERROR'
2018-10-31 09:20:40 [DEBUG   ] Got command RPT from MCS: ref #330226
2018-10-31 09:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330226  77 58422 33640118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:20:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:21:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 09:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:21:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:21:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:21:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:21:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:21:15 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-10-31 09:21:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 09:21:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:22:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:22:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:22:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:22:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:22:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:22:15 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-10-31 09:22:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 09:22:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 09:23:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 09:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 09:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:23:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:23:15 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-31 09:23:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 09:23:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 09:24:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:24:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:24:15 [DEBUG   ] Finished updating board flags in 1.867 seconds
2018-10-31 09:24:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:24:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 09:25:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 09:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 09:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:25:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:25:15 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-31 09:25:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 09:25:34 [DEBUG   ] Got command RPT from MCS: ref #330252
2018-10-31 09:25:34 [DEBUG   ] summary = ERROR
2018-10-31 09:25:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330252  13 58422 33934321 A  ERRORERROR'
2018-10-31 09:25:34 [DEBUG   ] Got command RPT from MCS: ref #330253
2018-10-31 09:25:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:25:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330253  77 58422 33934525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:25:34 [DEBUG   ] Got command RPT from MCS: ref #330254
2018-10-31 09:25:34 [DEBUG   ] summary = ERROR
2018-10-31 09:25:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330254  13 58422 33934729 A  ERRORERROR'
2018-10-31 09:25:34 [DEBUG   ] Got command RPT from MCS: ref #330256
2018-10-31 09:25:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:25:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330256  77 58422 33934921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:25:35 [DEBUG   ] Got command RPT from MCS: ref #330257
2018-10-31 09:25:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330257  12 58422 33935125 A  ERRORB'
2018-10-31 09:25:40 [DEBUG   ] Got command RPT from MCS: ref #330262
2018-10-31 09:25:40 [DEBUG   ] summary = ERROR
2018-10-31 09:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330262  13 58422 33940302 A  ERRORERROR'
2018-10-31 09:25:40 [DEBUG   ] Got command RPT from MCS: ref #330263
2018-10-31 09:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330263  77 58422 33940303 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:25:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 09:26:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 09:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:26:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:26:15 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-31 09:26:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 09:26:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:27:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 09:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:27:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:27:15 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-31 09:27:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-31 09:27:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 09:28:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-31 09:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:28:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:28:15 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-31 09:28:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 09:28:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-31 09:29:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 09:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 09:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:29:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:29:15 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-10-31 09:29:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 09:29:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-31 09:30:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 09:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:30:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:30:15 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-31 09:30:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:30:34 [DEBUG   ] Got command RPT from MCS: ref #330283
2018-10-31 09:30:34 [DEBUG   ] summary = ERROR
2018-10-31 09:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330283  13 58422 34234409 A  ERRORERROR'
2018-10-31 09:30:34 [DEBUG   ] Got command RPT from MCS: ref #330284
2018-10-31 09:30:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330284  77 58422 34234613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:30:34 [DEBUG   ] Got command RPT from MCS: ref #330285
2018-10-31 09:30:34 [DEBUG   ] summary = ERROR
2018-10-31 09:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330285  13 58422 34234817 A  ERRORERROR'
2018-10-31 09:30:35 [DEBUG   ] Got command RPT from MCS: ref #330286
2018-10-31 09:30:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330286  77 58422 34235009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:30:35 [DEBUG   ] Got command RPT from MCS: ref #330287
2018-10-31 09:30:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330287  12 58422 34235213 A  ERRORB'
2018-10-31 09:30:40 [DEBUG   ] Got command RPT from MCS: ref #330288
2018-10-31 09:30:40 [DEBUG   ] summary = ERROR
2018-10-31 09:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330288  13 58422 34240121 A  ERRORERROR'
2018-10-31 09:30:40 [DEBUG   ] Got command RPT from MCS: ref #330289
2018-10-31 09:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330289  77 58422 34240122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:30:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:31:13 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 09:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:31:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:31:15 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-31 09:31:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-31 09:31:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:32:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:32:15 [WARNING ] (13, 1, 'bot')
2018-10-31 09:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:32:15 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-10-31 09:32:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-31 09:32:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 09:33:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:33:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:33:16 [DEBUG   ] Finished updating board flags in 2.142 seconds
2018-10-31 09:33:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 09:33:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 09:34:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:34:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:34:16 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-31 09:34:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-31 09:34:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 09:35:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 09:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:35:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:35:16 [DEBUG   ] Finished updating board flags in 1.933 seconds
2018-10-31 09:35:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 09:35:34 [DEBUG   ] Got command RPT from MCS: ref #330315
2018-10-31 09:35:34 [DEBUG   ] summary = ERROR
2018-10-31 09:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330315  13 58422 34534493 A  ERRORERROR'
2018-10-31 09:35:34 [DEBUG   ] Got command RPT from MCS: ref #330316
2018-10-31 09:35:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330316  77 58422 34534697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:35:34 [DEBUG   ] Got command RPT from MCS: ref #330317
2018-10-31 09:35:34 [DEBUG   ] summary = ERROR
2018-10-31 09:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330317  13 58422 34534901 A  ERRORERROR'
2018-10-31 09:35:35 [DEBUG   ] Got command RPT from MCS: ref #330319
2018-10-31 09:35:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:35:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330319  77 58422 34535093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:35:35 [DEBUG   ] Got command RPT from MCS: ref #330320
2018-10-31 09:35:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:35:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330320  12 58422 34535297 A  ERRORB'
2018-10-31 09:35:40 [DEBUG   ] Got command RPT from MCS: ref #330325
2018-10-31 09:35:40 [DEBUG   ] summary = ERROR
2018-10-31 09:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330325  13 58422 34540121 A  ERRORERROR'
2018-10-31 09:35:40 [DEBUG   ] Got command RPT from MCS: ref #330326
2018-10-31 09:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330326  77 58422 34540122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:35:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 09:36:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-31 09:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 09:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:36:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:36:16 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-31 09:36:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 09:36:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:37:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 09:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 09:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:37:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:37:16 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-31 09:37:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 09:37:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 09:38:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:38:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:38:16 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-31 09:38:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-31 09:38:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-31 09:39:00 [DEBUG   ] Got command RPT from MCS: ref #330346
2018-10-31 09:39:00 [DEBUG   ] summary = ERROR
2018-10-31 09:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330346  13 58422 34740357 A  ERRORERROR'
2018-10-31 09:39:00 [DEBUG   ] Got command RPT from MCS: ref #330347
2018-10-31 09:39:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330347  77 58422 34740358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:39:05 [DEBUG   ] Got command INI from MCS: ref #330348
2018-10-31 09:39:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-31 09:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   330348   8 58422 34745377 ABOOTING'
2018-10-31 09:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:39:16 [WARNING ] (13, 1, 'bot')
2018-10-31 09:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:39:16 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-31 09:39:29 [INFO    ] -------------------
2018-10-31 09:39:29 [INFO    ]  LWA board status
2018-10-31 09:39:29 [INFO    ] -------------------
2018-10-31 09:39:29 [INFO    ] DP 1: 2 lwa27
2018-10-31 09:39:29 [INFO    ] DP 1: 3 lwa24
2018-10-31 09:39:29 [INFO    ] DP 1: 4 lwa23
2018-10-31 09:39:29 [INFO    ] DP 1: 5 lwa18
2018-10-31 09:39:29 [INFO    ] DP 1: 6 lwa10
2018-10-31 09:39:29 [INFO    ] DP 1: 7 lwa32
2018-10-31 09:39:29 [INFO    ] DP 1: 8 lwa11
2018-10-31 09:39:29 [INFO    ] DP 1: 9 lwa30
2018-10-31 09:39:29 [INFO    ] DP 1: 10 lwa12
2018-10-31 09:39:29 [INFO    ] DP 1: 11 lwa8
2018-10-31 09:39:29 [INFO    ] DP 1: 12 lwa13
2018-10-31 09:39:29 [INFO    ] DP 1: 13 lwa26
2018-10-31 09:39:29 [INFO    ] DP 1: 14 lwa14
2018-10-31 09:39:29 [INFO    ] DP 1: 16 lwa22
2018-10-31 09:39:29 [INFO    ] DP 1: 17 lwa20
2018-10-31 09:39:29 [INFO    ] DP 1: 18 lwa1
2018-10-31 09:39:29 [INFO    ] DP 1: 19 lwa5
2018-10-31 09:39:29 [INFO    ] DP 1: 20 lwa25
2018-10-31 09:39:29 [INFO    ] DP 1: 21 lwa35
2018-10-31 09:39:29 [INFO    ] DP 1: 22 lwa19
2018-10-31 09:39:29 [INFO    ] DP 1: 23 lwa21
2018-10-31 09:39:29 [INFO    ] DP 1: 24 lwa6
2018-10-31 09:39:29 [INFO    ] DP 1: 25 lwa7
2018-10-31 09:39:29 [INFO    ] DP 1: 26 lwa33
2018-10-31 09:39:29 [INFO    ] DP 1: 27 lwa15
2018-10-31 09:39:29 [INFO    ] DP 1: 28 lwa28
2018-10-31 09:39:29 [INFO    ] DP 2: 1 lwa16
2018-10-31 09:39:29 [INFO    ] DP 2: 15 lwa34
2018-10-31 09:39:29 [INFO    ] Total of 28 boards
2018-10-31 09:39:29 [INFO    ] Total of 260 stands
2018-10-31 09:39:29 [INFO    ] -------------------
2018-10-31 09:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31975
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31976
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31977
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31978
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31979
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31980
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31981
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31982
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31983
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31984
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31985
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31986
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31987
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31988
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31989
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31990
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31991
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31992
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31993
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31994
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31995
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31996
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31997
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31998
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31999
2018-10-31 09:39:36 [DEBUG   ] 2018-10-31 09:39:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32000
2018-10-31 09:39:48 [DEBUG   ] 2018-10-31 09:39:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31975 exited with status 0
2018-10-31 09:39:48 [DEBUG   ] 2018-10-31 09:39:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31976 exited with status 0
2018-10-31 09:39:48 [DEBUG   ] 2018-10-31 09:39:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31977 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31978 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31979 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31980 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31981 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31982 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31983 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31984 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31985 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31986 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31987 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31988 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31989 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31990 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31991 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31992 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31993 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31994 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31995 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31996 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31997 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31998 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31999 exited with status 0
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32000 exited with status 0
2018-10-31 09:39:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] spawn_process: at 2018-10-31 09:39:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32027
2018-10-31 09:39:49 [DEBUG   ] 2018-10-31 09:39:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32028
2018-10-31 09:39:54 [DEBUG   ] 2018-10-31 09:39:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32027 exited with status 0
2018-10-31 09:39:54 [DEBUG   ] 2018-10-31 09:39:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32028 exited with status 0
2018-10-31 09:39:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-31 09:39:54 [DEBUG   ] spawn_process: at 2018-10-31 09:39:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-31 09:39:54 [DEBUG   ] spawn_process: at 2018-10-31 09:39:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-31 09:39:54 [INFO    ] Setting Beam 1 xbars
2018-10-31 09:39:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-31 09:39:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-31 09:39:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-31 09:39:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-31 09:39:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-31 09:39:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-31 09:39:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-31 09:39:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-31 09:39:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-31 09:40:00 [INFO    ] Setting Beam 2 xbars
2018-10-31 09:40:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-31 09:40:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-31 09:40:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-31 09:40:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-31 09:40:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-31 09:40:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-31 09:40:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-31 09:40:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-31 09:40:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-31 09:40:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-31 09:40:05 [INFO    ] Setting Beam 3 xbars
2018-10-31 09:40:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-31 09:40:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-31 09:40:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-31 09:40:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-31 09:40:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-31 09:40:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-31 09:40:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-31 09:40:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-31 09:40:11 [INFO    ] Setting Beam 4 xbars
2018-10-31 09:40:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-31 09:40:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-31 09:40:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-31 09:40:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-31 09:40:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-31 09:40:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-31 09:40:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-31 09:40:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-31 09:40:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-31 09:40:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-31 09:40:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-31 09:40:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-31 09:40:16 [INFO    ] All xbars set
2018-10-31 09:40:16 [INFO    ] Setting adder chain routing for all beams
2018-10-31 09:40:21 [INFO    ] Setting beam ids
2018-10-31 09:40:31 [INFO    ] Starting beam delay calibration
2018-10-31 09:40:34 [DEBUG   ] Got command RPT from MCS: ref #330353
2018-10-31 09:40:34 [DEBUG   ] summary = ERROR
2018-10-31 09:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330353  13 58422 34834581 A  ERRORERROR'
2018-10-31 09:40:34 [DEBUG   ] Got command RPT from MCS: ref #330354
2018-10-31 09:40:34 [DEBUG   ] info = Starting calibration
2018-10-31 09:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330354  28 58422 34834785 A  ERRORStarting calibration'
2018-10-31 09:40:34 [DEBUG   ] Got command RPT from MCS: ref #330355
2018-10-31 09:40:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330355  12 58422 34834989 A  ERRORB'
2018-10-31 09:40:40 [DEBUG   ] Got command RPT from MCS: ref #330356
2018-10-31 09:40:40 [DEBUG   ] summary = ERROR
2018-10-31 09:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330356  13 58422 34840125 A  ERRORERROR'
2018-10-31 09:40:40 [DEBUG   ] Got command RPT from MCS: ref #330357
2018-10-31 09:40:40 [DEBUG   ] info = Starting calibration
2018-10-31 09:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330357  28 58422 34840126 A  ERRORStarting calibration'
2018-10-31 09:40:43 [INFO    ] Beam 1 latency is 5734
2018-10-31 09:40:43 [INFO    ] Beam 2 latency is 5745
2018-10-31 09:40:43 [INFO    ] Beam 3 latency is 5740
2018-10-31 09:40:43 [INFO    ] Beam 4 latency is 5740
2018-10-31 09:40:43 [INFO    ] Stop calibration
2018-10-31 09:40:51 [INFO    ] Beam delay calibration successful
2018-10-31 09:40:51 [INFO    ] Calibration passed
2018-10-31 09:40:51 [DEBUG   ] spawn_process: at 2018-10-31 09:40:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-31 09:40:51 [DEBUG   ] spawn_process: at 2018-10-31 09:40:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-31 09:40:51 [DEBUG   ] spawn_process: at 2018-10-31 09:40:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-31 09:40:51 [DEBUG   ] spawn_process: at 2018-10-31 09:40:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-31 09:40:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-31 09:40:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2018-10-31 09:40:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 289 ms (1540978852.293 s) with PID 1160 and time 1540978853
2018-10-31 09:40:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2018-10-31 09:40:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 379 ms (1540978852.382 s) with PID 1163 and time 1540978853
2018-10-31 09:40:53 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2018-10-31 09:40:53 [INFO    ] Started antennas statistics background thread
2018-10-31 09:40:53 [INFO    ] Started board flags background thread
2018-10-31 09:40:53 [INFO    ] Started BAM background thread
2018-10-31 09:40:53 [INFO    ] Finished the INI process (ref. #330348) in 108.128 s
2018-10-31 09:40:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:40:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:40:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:40:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:40:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:40:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-31 09:40:54 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-10-31 09:41:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:41:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:41:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:41:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:41:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:41:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:41:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:41:54 [WARNING ] (13, 1, 'bot')
2018-10-31 09:41:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-31 09:41:54 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-10-31 09:42:05 [DEBUG   ] Got command RPT from MCS: ref #330373
2018-10-31 09:42:05 [DEBUG   ] summary = ERROR
2018-10-31 09:42:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330373  13 58422 34925365 A  ERRORERROR'
2018-10-31 09:42:05 [DEBUG   ] Got command RPT from MCS: ref #330374
2018-10-31 09:42:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:42:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330374  98 58422 34925366 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:42:10 [DEBUG   ] Got command INI from MCS: ref #330375
2018-10-31 09:42:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-31 09:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   330375   8 58422 34930414 ABOOTING'
2018-10-31 09:42:13 [DEBUG   ] Finished updating ant stats in 0.817 seconds
2018-10-31 09:42:31 [INFO    ] -------------------
2018-10-31 09:42:31 [INFO    ]  LWA board status
2018-10-31 09:42:31 [INFO    ] -------------------
2018-10-31 09:42:31 [INFO    ] DP 1: 2 lwa27
2018-10-31 09:42:31 [INFO    ] DP 1: 3 lwa24
2018-10-31 09:42:31 [INFO    ] DP 1: 4 lwa23
2018-10-31 09:42:31 [INFO    ] DP 1: 5 lwa18
2018-10-31 09:42:31 [INFO    ] DP 1: 6 lwa10
2018-10-31 09:42:31 [INFO    ] DP 1: 7 lwa32
2018-10-31 09:42:31 [INFO    ] DP 1: 8 lwa11
2018-10-31 09:42:31 [INFO    ] DP 1: 9 lwa30
2018-10-31 09:42:31 [INFO    ] DP 1: 10 lwa12
2018-10-31 09:42:31 [INFO    ] DP 1: 11 lwa8
2018-10-31 09:42:31 [INFO    ] DP 1: 12 lwa13
2018-10-31 09:42:31 [INFO    ] DP 1: 13 lwa26
2018-10-31 09:42:31 [INFO    ] DP 1: 14 lwa14
2018-10-31 09:42:31 [INFO    ] DP 1: 16 lwa22
2018-10-31 09:42:31 [INFO    ] DP 1: 17 lwa20
2018-10-31 09:42:31 [INFO    ] DP 1: 18 lwa1
2018-10-31 09:42:31 [INFO    ] DP 1: 19 lwa5
2018-10-31 09:42:31 [INFO    ] DP 1: 20 lwa25
2018-10-31 09:42:31 [INFO    ] DP 1: 21 lwa35
2018-10-31 09:42:31 [INFO    ] DP 1: 22 lwa19
2018-10-31 09:42:31 [INFO    ] DP 1: 23 lwa21
2018-10-31 09:42:31 [INFO    ] DP 1: 24 lwa6
2018-10-31 09:42:31 [INFO    ] DP 1: 25 lwa7
2018-10-31 09:42:31 [INFO    ] DP 1: 26 lwa33
2018-10-31 09:42:31 [INFO    ] DP 1: 27 lwa15
2018-10-31 09:42:31 [INFO    ] DP 1: 28 lwa28
2018-10-31 09:42:31 [INFO    ] DP 2: 1 lwa16
2018-10-31 09:42:31 [INFO    ] DP 2: 15 lwa34
2018-10-31 09:42:31 [INFO    ] Total of 28 boards
2018-10-31 09:42:31 [INFO    ] Total of 260 stands
2018-10-31 09:42:31 [INFO    ] -------------------
2018-10-31 09:42:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1716
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1717
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1718
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1719
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1720
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1721
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1722
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1723
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1724
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1725
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1726
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1727
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1728
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1729
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1730
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1731
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1732
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1733
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1734
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1735
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1736
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1737
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1738
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1739
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1740
2018-10-31 09:42:38 [DEBUG   ] 2018-10-31 09:42:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1741
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1716 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1717 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1718 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1719 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1720 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1721 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1722 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1723 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1724 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1725 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1726 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1727 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1728 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1729 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1730 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1731 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1732 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1733 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1734 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1735 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1736 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1737 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1738 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1739 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1740 exited with status 0
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1741 exited with status 0
2018-10-31 09:42:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] spawn_process: at 2018-10-31 09:42:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1768
2018-10-31 09:42:50 [DEBUG   ] 2018-10-31 09:42:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1769
2018-10-31 09:42:56 [DEBUG   ] 2018-10-31 09:42:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1768 exited with status 0
2018-10-31 09:42:56 [DEBUG   ] 2018-10-31 09:42:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1769 exited with status 0
2018-10-31 09:42:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-31 09:42:56 [DEBUG   ] spawn_process: at 2018-10-31 09:42:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-31 09:42:56 [DEBUG   ] spawn_process: at 2018-10-31 09:42:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-31 09:42:56 [INFO    ] Setting Beam 1 xbars
2018-10-31 09:42:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-31 09:42:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-31 09:42:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-31 09:42:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-31 09:42:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-31 09:42:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-31 09:42:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-31 09:42:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-31 09:42:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-31 09:43:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-31 09:43:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-31 09:43:02 [INFO    ] Setting Beam 2 xbars
2018-10-31 09:43:02 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-31 09:43:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-31 09:43:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-31 09:43:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-31 09:43:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-31 09:43:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-31 09:43:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-31 09:43:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-31 09:43:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-31 09:43:07 [INFO    ] Setting Beam 3 xbars
2018-10-31 09:43:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-31 09:43:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-31 09:43:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-31 09:43:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-31 09:43:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-31 09:43:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-31 09:43:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-31 09:43:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-31 09:43:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-31 09:43:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-31 09:43:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-31 09:43:12 [INFO    ] Setting Beam 4 xbars
2018-10-31 09:43:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-31 09:43:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-31 09:43:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-31 09:43:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-31 09:43:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-31 09:43:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-31 09:43:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-31 09:43:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-31 09:43:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-31 09:43:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-31 09:43:18 [INFO    ] All xbars set
2018-10-31 09:43:18 [INFO    ] Setting adder chain routing for all beams
2018-10-31 09:43:23 [INFO    ] Setting beam ids
2018-10-31 09:43:33 [INFO    ] Starting beam delay calibration
2018-10-31 09:43:45 [INFO    ] Beam 1 latency is 5726
2018-10-31 09:43:45 [INFO    ] Beam 2 latency is 5729
2018-10-31 09:43:45 [INFO    ] Beam 3 latency is 5733
2018-10-31 09:43:45 [INFO    ] Beam 4 latency is 5711
2018-10-31 09:43:45 [INFO    ] Stop calibration
2018-10-31 09:43:53 [INFO    ] Beam delay calibration successful
2018-10-31 09:43:53 [INFO    ] Calibration passed
2018-10-31 09:43:53 [DEBUG   ] spawn_process: at 2018-10-31 09:43:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-31 09:43:53 [DEBUG   ] spawn_process: at 2018-10-31 09:43:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-31 09:43:53 [DEBUG   ] spawn_process: at 2018-10-31 09:43:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-31 09:43:53 [DEBUG   ] spawn_process: at 2018-10-31 09:43:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-31 09:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-31 09:43:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2018-10-31 09:43:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 294 ms (1540979034.297 s) with PID 3451 and time 1540979035
2018-10-31 09:43:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-31 09:43:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 383 ms (1540979034.386 s) with PID 3454 and time 1540979035
2018-10-31 09:43:55 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-10-31 09:43:55 [INFO    ] Started antennas statistics background thread
2018-10-31 09:43:55 [INFO    ] Started board flags background thread
2018-10-31 09:43:55 [INFO    ] Started BAM background thread
2018-10-31 09:43:55 [INFO    ] Finished the INI process (ref. #330375) in 105.096 s
2018-10-31 09:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:43:56 [DEBUG   ] Finished updating board flags in 1.050 seconds
2018-10-31 09:44:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:44:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:44:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 09:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:44:56 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-10-31 09:45:10 [DEBUG   ] Got command RPT from MCS: ref #330382
2018-10-31 09:45:10 [DEBUG   ] summary = ERROR
2018-10-31 09:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330382  13 58422 35110374 A  ERRORERROR'
2018-10-31 09:45:10 [DEBUG   ] Got command RPT from MCS: ref #330383
2018-10-31 09:45:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330383  77 58422 35110374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:45:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 09:45:34 [DEBUG   ] Got command RPT from MCS: ref #330384
2018-10-31 09:45:34 [DEBUG   ] summary = ERROR
2018-10-31 09:45:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330384  13 58422 35134674 A  ERRORERROR'
2018-10-31 09:45:34 [DEBUG   ] Got command RPT from MCS: ref #330385
2018-10-31 09:45:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:45:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330385  77 58422 35134866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:45:35 [DEBUG   ] Got command RPT from MCS: ref #330386
2018-10-31 09:45:35 [DEBUG   ] summary = ERROR
2018-10-31 09:45:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330386  13 58422 35135069 A  ERRORERROR'
2018-10-31 09:45:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:45:35 [DEBUG   ] Got command RPT from MCS: ref #330388
2018-10-31 09:45:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:45:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330388  77 58422 35135273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:45:35 [DEBUG   ] Got command RPT from MCS: ref #330390
2018-10-31 09:45:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:45:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330390  12 58422 35135466 A  ERRORB'
2018-10-31 09:45:40 [DEBUG   ] Got command RPT from MCS: ref #330394
2018-10-31 09:45:40 [DEBUG   ] summary = ERROR
2018-10-31 09:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330394  13 58422 35140121 A  ERRORERROR'
2018-10-31 09:45:40 [DEBUG   ] Got command RPT from MCS: ref #330395
2018-10-31 09:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330395  77 58422 35140122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:45:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:45:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 09:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-31 09:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:45:56 [DEBUG   ] Finished updating board flags in 1.273 seconds
2018-10-31 09:46:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:46:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:46:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:46:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:46:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:46:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:46:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:46:57 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-31 09:47:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:47:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 09:47:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 09:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:47:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:47:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:47:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:47:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:47:57 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-31 09:48:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 09:48:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:48:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:48:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:48:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:48:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:48:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:48:57 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-31 09:49:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:49:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:49:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:49:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:49:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:49:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:49:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:49:57 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-31 09:50:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 09:50:34 [DEBUG   ] Got command RPT from MCS: ref #330419
2018-10-31 09:50:34 [DEBUG   ] summary = ERROR
2018-10-31 09:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330419  13 58422 35434757 A  ERRORERROR'
2018-10-31 09:50:34 [DEBUG   ] Got command RPT from MCS: ref #330420
2018-10-31 09:50:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330420  77 58422 35434949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:50:35 [DEBUG   ] Got command RPT from MCS: ref #330421
2018-10-31 09:50:35 [DEBUG   ] summary = ERROR
2018-10-31 09:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330421  13 58422 35435157 A  ERRORERROR'
2018-10-31 09:50:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:50:35 [DEBUG   ] Got command RPT from MCS: ref #330422
2018-10-31 09:50:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330422  77 58422 35435361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:50:35 [DEBUG   ] Got command RPT from MCS: ref #330423
2018-10-31 09:50:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330423  12 58422 35435553 A  ERRORB'
2018-10-31 09:50:40 [DEBUG   ] Got command RPT from MCS: ref #330424
2018-10-31 09:50:40 [DEBUG   ] summary = ERROR
2018-10-31 09:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330424  13 58422 35440125 A  ERRORERROR'
2018-10-31 09:50:40 [DEBUG   ] Got command RPT from MCS: ref #330425
2018-10-31 09:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330425  77 58422 35440126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:50:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:50:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 09:50:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:50:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:50:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:50:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:50:57 [DEBUG   ] Finished updating board flags in 1.239 seconds
2018-10-31 09:51:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:51:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:51:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:51:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:51:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:51:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:51:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:51:57 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-10-31 09:52:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:52:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:52:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 09:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:52:57 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-10-31 09:53:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:53:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:53:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:53:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:53:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:53:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:53:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:53:58 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-31 09:54:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 09:54:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:54:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:54:57 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-31 09:55:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:55:34 [DEBUG   ] Got command RPT from MCS: ref #330451
2018-10-31 09:55:34 [DEBUG   ] summary = ERROR
2018-10-31 09:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330451  13 58422 35734837 A  ERRORERROR'
2018-10-31 09:55:35 [DEBUG   ] Got command RPT from MCS: ref #330452
2018-10-31 09:55:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:55:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330452  77 58422 35735041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:55:35 [DEBUG   ] Got command RPT from MCS: ref #330453
2018-10-31 09:55:35 [DEBUG   ] summary = ERROR
2018-10-31 09:55:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330453  13 58422 35735246 A  ERRORERROR'
2018-10-31 09:55:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:55:35 [DEBUG   ] Got command RPT from MCS: ref #330455
2018-10-31 09:55:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:55:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330455  77 58422 35735437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:55:35 [DEBUG   ] Got command RPT from MCS: ref #330457
2018-10-31 09:55:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 09:55:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330457  12 58422 35735641 A  ERRORB'
2018-10-31 09:55:40 [DEBUG   ] Got command RPT from MCS: ref #330461
2018-10-31 09:55:40 [DEBUG   ] summary = ERROR
2018-10-31 09:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330461  13 58422 35740117 A  ERRORERROR'
2018-10-31 09:55:40 [DEBUG   ] Got command RPT from MCS: ref #330462
2018-10-31 09:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 09:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330462  77 58422 35740118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 09:55:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 09:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:55:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:55:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:55:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:55:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:55:58 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-31 09:56:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:56:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:56:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:56:57 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-10-31 09:57:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:57:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:57:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-31 09:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:57:57 [DEBUG   ] Finished updating board flags in 1.041 seconds
2018-10-31 09:58:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:58:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:58:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 09:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:58:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:58:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:58:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:58:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:58:58 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-31 09:59:15 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 09:59:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:59:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 09:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 09:59:58 [DEBUG   ] Got command DRX from MCS: ref #330484
2018-10-31 09:59:58 [INFO    ] sending drx command to lwa16
2018-10-31 09:59:58 [DEBUG   ] run_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 60000000.0 7 9 0']
2018-10-31 09:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-31 09:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   330484   8 58422 35998014 A  ERROR'
2018-10-31 09:59:58 [DEBUG   ] Got command DRX from MCS: ref #330485
2018-10-31 09:59:58 [INFO    ] sending drx command to lwa16
2018-10-31 09:59:58 [DEBUG   ] run_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74000000.0 7 9 0']
2018-10-31 09:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-31 09:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   330485   8 58422 35998018 A  ERROR'
2018-10-31 09:59:58 [DEBUG   ] Got command BAM from MCS: ref #330486
2018-10-31 09:59:58 [INFO    ] Finished processing BAM request
2018-10-31 09:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 09:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330486   8 58422 35998033 A  ERROR'
2018-10-31 09:59:58 [INFO    ] Finished starting DRX
2018-10-31 09:59:58 [INFO    ] Finished starting DRX
2018-10-31 09:59:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:59:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:59:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:59:58 [WARNING ] (13, 1, 'bot')
2018-10-31 09:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 09:59:58 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 09:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 09:59:58 [DEBUG   ] spawn_process: at 2018-10-31 09:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:00:09 [DEBUG   ] Got command BAM from MCS: ref #330488
2018-10-31 10:00:09 [INFO    ] Finished processing BAM request
2018-10-31 10:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330488   8 58422 36009025 A  ERROR'
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:00:09 [DEBUG   ] spawn_process: at 2018-10-31 10:00:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:00:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 10:00:20 [DEBUG   ] Got command BAM from MCS: ref #330489
2018-10-31 10:00:20 [INFO    ] Finished processing BAM request
2018-10-31 10:00:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330489   8 58422 36020029 A  ERROR'
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:00:20 [DEBUG   ] spawn_process: at 2018-10-31 10:00:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:00:31 [DEBUG   ] Got command BAM from MCS: ref #330490
2018-10-31 10:00:31 [INFO    ] Finished processing BAM request
2018-10-31 10:00:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330490   8 58422 36031029 A  ERROR'
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:00:31 [DEBUG   ] spawn_process: at 2018-10-31 10:00:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:00:34 [DEBUG   ] Got command RPT from MCS: ref #330491
2018-10-31 10:00:34 [DEBUG   ] summary = ERROR
2018-10-31 10:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330491  13 58422 36034925 A  ERRORERROR'
2018-10-31 10:00:35 [DEBUG   ] Got command RPT from MCS: ref #330492
2018-10-31 10:00:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330492  77 58422 36035117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:00:35 [DEBUG   ] Got command RPT from MCS: ref #330493
2018-10-31 10:00:35 [DEBUG   ] summary = ERROR
2018-10-31 10:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330493  13 58422 36035322 A  ERRORERROR'
2018-10-31 10:00:35 [DEBUG   ] Got command RPT from MCS: ref #330494
2018-10-31 10:00:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330494  77 58422 36035525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:00:35 [DEBUG   ] Got command RPT from MCS: ref #330495
2018-10-31 10:00:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330495  12 58422 36035729 A  ERRORB'
2018-10-31 10:00:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:00:40 [DEBUG   ] Got command RPT from MCS: ref #330496
2018-10-31 10:00:40 [DEBUG   ] summary = ERROR
2018-10-31 10:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330496  13 58422 36040125 A  ERRORERROR'
2018-10-31 10:00:40 [DEBUG   ] Got command RPT from MCS: ref #330497
2018-10-31 10:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330497  77 58422 36040126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:00:42 [DEBUG   ] Got command BAM from MCS: ref #330513
2018-10-31 10:00:42 [INFO    ] Finished processing BAM request
2018-10-31 10:00:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:00:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330513   8 58422 36042025 A  ERROR'
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:00:42 [DEBUG   ] spawn_process: at 2018-10-31 10:00:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:00:53 [DEBUG   ] Got command BAM from MCS: ref #330514
2018-10-31 10:00:53 [INFO    ] Finished processing BAM request
2018-10-31 10:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330514   8 58422 36053033 A  ERROR'
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:00:53 [DEBUG   ] spawn_process: at 2018-10-31 10:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:00:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:00:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:00:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:00:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:00:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:00:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:00:58 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-10-31 10:01:04 [DEBUG   ] Got command BAM from MCS: ref #330519
2018-10-31 10:01:04 [INFO    ] Finished processing BAM request
2018-10-31 10:01:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330519   8 58422 36064033 A  ERROR'
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:01:04 [DEBUG   ] spawn_process: at 2018-10-31 10:01:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:01:15 [DEBUG   ] Got command BAM from MCS: ref #330520
2018-10-31 10:01:15 [INFO    ] Finished processing BAM request
2018-10-31 10:01:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330520   8 58422 36075029 A  ERROR'
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:01:15 [DEBUG   ] spawn_process: at 2018-10-31 10:01:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:01:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 10:01:26 [DEBUG   ] Got command BAM from MCS: ref #330521
2018-10-31 10:01:26 [INFO    ] Finished processing BAM request
2018-10-31 10:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330521   8 58422 36086025 A  ERROR'
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:01:26 [DEBUG   ] spawn_process: at 2018-10-31 10:01:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:01:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:01:37 [DEBUG   ] Got command BAM from MCS: ref #330522
2018-10-31 10:01:37 [INFO    ] Finished processing BAM request
2018-10-31 10:01:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330522   8 58422 36097033 A  ERROR'
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:01:37 [DEBUG   ] spawn_process: at 2018-10-31 10:01:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:01:48 [DEBUG   ] Got command BAM from MCS: ref #330523
2018-10-31 10:01:48 [INFO    ] Finished processing BAM request
2018-10-31 10:01:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330523   8 58422 36108041 A  ERROR'
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:01:48 [DEBUG   ] spawn_process: at 2018-10-31 10:01:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:01:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-31 10:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:01:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:01:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:01:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:01:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:01:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:01:58 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-10-31 10:01:59 [DEBUG   ] Got command BAM from MCS: ref #330524
2018-10-31 10:01:59 [INFO    ] Finished processing BAM request
2018-10-31 10:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330524   8 58422 36119029 A  ERROR'
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:01:59 [DEBUG   ] spawn_process: at 2018-10-31 10:01:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:02:10 [DEBUG   ] Got command BAM from MCS: ref #330525
2018-10-31 10:02:10 [INFO    ] Finished processing BAM request
2018-10-31 10:02:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330525   8 58422 36130025 A  ERROR'
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:02:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:02:10 [DEBUG   ] spawn_process: at 2018-10-31 10:02:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:02:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:02:21 [DEBUG   ] Got command BAM from MCS: ref #330526
2018-10-31 10:02:21 [INFO    ] Finished processing BAM request
2018-10-31 10:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330526   8 58422 36141029 A  ERROR'
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:02:21 [DEBUG   ] spawn_process: at 2018-10-31 10:02:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:02:32 [DEBUG   ] Got command BAM from MCS: ref #330527
2018-10-31 10:02:32 [INFO    ] Finished processing BAM request
2018-10-31 10:02:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330527   8 58422 36152033 A  ERROR'
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:02:32 [DEBUG   ] spawn_process: at 2018-10-31 10:02:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:02:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:02:43 [DEBUG   ] Got command BAM from MCS: ref #330528
2018-10-31 10:02:43 [INFO    ] Finished processing BAM request
2018-10-31 10:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330528   8 58422 36163029 A  ERROR'
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:02:43 [DEBUG   ] spawn_process: at 2018-10-31 10:02:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:02:54 [DEBUG   ] Got command BAM from MCS: ref #330529
2018-10-31 10:02:54 [INFO    ] Finished processing BAM request
2018-10-31 10:02:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:02:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330529   8 58422 36174025 A  ERROR'
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:02:54 [DEBUG   ] spawn_process: at 2018-10-31 10:02:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:02:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:02:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:02:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:02:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:02:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:02:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:02:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:02:59 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-31 10:03:05 [DEBUG   ] Got command BAM from MCS: ref #330530
2018-10-31 10:03:05 [INFO    ] Finished processing BAM request
2018-10-31 10:03:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330530   8 58422 36185033 A  ERROR'
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:03:05 [DEBUG   ] spawn_process: at 2018-10-31 10:03:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:03:16 [DEBUG   ] Got command BAM from MCS: ref #330531
2018-10-31 10:03:16 [INFO    ] Finished processing BAM request
2018-10-31 10:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330531   8 58422 36196033 A  ERROR'
2018-10-31 10:03:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:03:16 [DEBUG   ] spawn_process: at 2018-10-31 10:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:03:27 [DEBUG   ] Got command BAM from MCS: ref #330532
2018-10-31 10:03:27 [INFO    ] Finished processing BAM request
2018-10-31 10:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330532   8 58422 36207033 A  ERROR'
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:03:27 [DEBUG   ] spawn_process: at 2018-10-31 10:03:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:03:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:03:38 [DEBUG   ] Got command BAM from MCS: ref #330533
2018-10-31 10:03:38 [INFO    ] Finished processing BAM request
2018-10-31 10:03:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330533   8 58422 36218033 A  ERROR'
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:03:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:03:38 [DEBUG   ] spawn_process: at 2018-10-31 10:03:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:03:49 [DEBUG   ] Got command BAM from MCS: ref #330534
2018-10-31 10:03:49 [INFO    ] Finished processing BAM request
2018-10-31 10:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330534   8 58422 36229033 A  ERROR'
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:03:49 [DEBUG   ] spawn_process: at 2018-10-31 10:03:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:03:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:03:58 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-10-31 10:04:00 [DEBUG   ] Got command BAM from MCS: ref #330539
2018-10-31 10:04:00 [INFO    ] Finished processing BAM request
2018-10-31 10:04:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330539   8 58422 36240033 A  ERROR'
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:04:00 [DEBUG   ] spawn_process: at 2018-10-31 10:04:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:04:11 [DEBUG   ] Got command BAM from MCS: ref #330540
2018-10-31 10:04:11 [INFO    ] Finished processing BAM request
2018-10-31 10:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330540   8 58422 36251029 A  ERROR'
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:04:11 [DEBUG   ] spawn_process: at 2018-10-31 10:04:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:04:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:04:22 [DEBUG   ] Got command BAM from MCS: ref #330541
2018-10-31 10:04:22 [INFO    ] Finished processing BAM request
2018-10-31 10:04:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330541   8 58422 36262029 A  ERROR'
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:04:22 [DEBUG   ] spawn_process: at 2018-10-31 10:04:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:04:33 [DEBUG   ] Got command BAM from MCS: ref #330542
2018-10-31 10:04:33 [INFO    ] Finished processing BAM request
2018-10-31 10:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330542   8 58422 36273033 A  ERROR'
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:04:33 [DEBUG   ] spawn_process: at 2018-10-31 10:04:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:04:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:04:44 [DEBUG   ] Got command BAM from MCS: ref #330543
2018-10-31 10:04:44 [INFO    ] Finished processing BAM request
2018-10-31 10:04:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330543   8 58422 36284033 A  ERROR'
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:04:44 [DEBUG   ] spawn_process: at 2018-10-31 10:04:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:04:55 [DEBUG   ] Got command BAM from MCS: ref #330544
2018-10-31 10:04:55 [INFO    ] Finished processing BAM request
2018-10-31 10:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330544   8 58422 36295025 A  ERROR'
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:04:55 [DEBUG   ] spawn_process: at 2018-10-31 10:04:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:04:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 10:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:04:58 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-10-31 10:05:06 [DEBUG   ] Got command BAM from MCS: ref #330545
2018-10-31 10:05:06 [INFO    ] Finished processing BAM request
2018-10-31 10:05:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330545   8 58422 36306029 A  ERROR'
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:05:06 [DEBUG   ] spawn_process: at 2018-10-31 10:05:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:05:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:05:17 [DEBUG   ] Got command BAM from MCS: ref #330548
2018-10-31 10:05:17 [INFO    ] Finished processing BAM request
2018-10-31 10:05:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330548   8 58422 36317029 A  ERROR'
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:05:17 [DEBUG   ] spawn_process: at 2018-10-31 10:05:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:05:28 [DEBUG   ] Got command BAM from MCS: ref #330549
2018-10-31 10:05:28 [INFO    ] Finished processing BAM request
2018-10-31 10:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330549   8 58422 36328033 A  ERROR'
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:05:28 [DEBUG   ] spawn_process: at 2018-10-31 10:05:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:05:35 [DEBUG   ] Got command RPT from MCS: ref #330550
2018-10-31 10:05:35 [DEBUG   ] summary = ERROR
2018-10-31 10:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330550  13 58422 36335005 A  ERRORERROR'
2018-10-31 10:05:35 [DEBUG   ] Got command RPT from MCS: ref #330551
2018-10-31 10:05:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330551  77 58422 36335209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:05:35 [DEBUG   ] Got command RPT from MCS: ref #330552
2018-10-31 10:05:35 [DEBUG   ] summary = ERROR
2018-10-31 10:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330552  13 58422 36335413 A  ERRORERROR'
2018-10-31 10:05:35 [DEBUG   ] Got command RPT from MCS: ref #330554
2018-10-31 10:05:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330554  77 58422 36335609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:05:35 [DEBUG   ] Got command RPT from MCS: ref #330556
2018-10-31 10:05:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330556  12 58422 36335813 A  ERRORB'
2018-10-31 10:05:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:05:39 [DEBUG   ] Got command BAM from MCS: ref #330560
2018-10-31 10:05:39 [INFO    ] Finished processing BAM request
2018-10-31 10:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330560   8 58422 36339033 A  ERROR'
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:05:39 [DEBUG   ] spawn_process: at 2018-10-31 10:05:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:05:40 [DEBUG   ] Got command RPT from MCS: ref #330561
2018-10-31 10:05:40 [DEBUG   ] summary = ERROR
2018-10-31 10:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330561  13 58422 36340125 A  ERRORERROR'
2018-10-31 10:05:40 [DEBUG   ] Got command RPT from MCS: ref #330562
2018-10-31 10:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330562  77 58422 36340126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:05:50 [DEBUG   ] Got command BAM from MCS: ref #330578
2018-10-31 10:05:50 [INFO    ] Finished processing BAM request
2018-10-31 10:05:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330578   8 58422 36350030 A  ERROR'
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:05:50 [DEBUG   ] spawn_process: at 2018-10-31 10:05:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:05:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:05:58 [DEBUG   ] Finished updating board flags in 1.250 seconds
2018-10-31 10:06:01 [DEBUG   ] Got command BAM from MCS: ref #330579
2018-10-31 10:06:01 [INFO    ] Finished processing BAM request
2018-10-31 10:06:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330579   8 58422 36361026 A  ERROR'
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:06:01 [DEBUG   ] spawn_process: at 2018-10-31 10:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:06:12 [DEBUG   ] Got command BAM from MCS: ref #330580
2018-10-31 10:06:12 [INFO    ] Finished processing BAM request
2018-10-31 10:06:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330580   8 58422 36372034 A  ERROR'
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:06:12 [DEBUG   ] spawn_process: at 2018-10-31 10:06:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:06:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:06:23 [DEBUG   ] Got command BAM from MCS: ref #330581
2018-10-31 10:06:23 [INFO    ] Finished processing BAM request
2018-10-31 10:06:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330581   8 58422 36383033 A  ERROR'
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:06:23 [DEBUG   ] spawn_process: at 2018-10-31 10:06:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:06:34 [DEBUG   ] Got command BAM from MCS: ref #330582
2018-10-31 10:06:34 [INFO    ] Finished processing BAM request
2018-10-31 10:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330582   8 58422 36394025 A  ERROR'
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:06:34 [DEBUG   ] spawn_process: at 2018-10-31 10:06:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:06:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:06:45 [DEBUG   ] Got command BAM from MCS: ref #330583
2018-10-31 10:06:45 [INFO    ] Finished processing BAM request
2018-10-31 10:06:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330583   8 58422 36405033 A  ERROR'
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:06:45 [DEBUG   ] spawn_process: at 2018-10-31 10:06:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:06:56 [DEBUG   ] Got command BAM from MCS: ref #330584
2018-10-31 10:06:56 [INFO    ] Finished processing BAM request
2018-10-31 10:06:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330584   8 58422 36416029 A  ERROR'
2018-10-31 10:06:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:06:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:06:56 [DEBUG   ] spawn_process: at 2018-10-31 10:06:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:06:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:06:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:06:58 [DEBUG   ] Finished updating board flags in 1.150 seconds
2018-10-31 10:07:07 [DEBUG   ] Got command BAM from MCS: ref #330589
2018-10-31 10:07:07 [INFO    ] Finished processing BAM request
2018-10-31 10:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330589   8 58422 36427033 A  ERROR'
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:07:07 [DEBUG   ] spawn_process: at 2018-10-31 10:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:07:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:07:18 [DEBUG   ] Got command BAM from MCS: ref #330590
2018-10-31 10:07:18 [INFO    ] Finished processing BAM request
2018-10-31 10:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330590   8 58422 36438025 A  ERROR'
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:07:18 [DEBUG   ] spawn_process: at 2018-10-31 10:07:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:07:29 [DEBUG   ] Got command BAM from MCS: ref #330591
2018-10-31 10:07:29 [INFO    ] Finished processing BAM request
2018-10-31 10:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330591   8 58422 36449033 A  ERROR'
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:07:29 [DEBUG   ] spawn_process: at 2018-10-31 10:07:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:07:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:07:40 [DEBUG   ] Got command BAM from MCS: ref #330592
2018-10-31 10:07:40 [INFO    ] Finished processing BAM request
2018-10-31 10:07:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330592   8 58422 36460025 A  ERROR'
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:07:40 [DEBUG   ] spawn_process: at 2018-10-31 10:07:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:07:51 [DEBUG   ] Got command BAM from MCS: ref #330593
2018-10-31 10:07:51 [INFO    ] Finished processing BAM request
2018-10-31 10:07:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:07:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330593   8 58422 36471049 A  ERROR'
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:07:51 [DEBUG   ] spawn_process: at 2018-10-31 10:07:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:07:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 10:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:07:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-31 10:08:02 [DEBUG   ] Got command BAM from MCS: ref #330594
2018-10-31 10:08:02 [INFO    ] Finished processing BAM request
2018-10-31 10:08:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:08:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330594   8 58422 36482029 A  ERROR'
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:08:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:08:02 [DEBUG   ] spawn_process: at 2018-10-31 10:08:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:08:13 [DEBUG   ] Got command BAM from MCS: ref #330595
2018-10-31 10:08:13 [INFO    ] Finished processing BAM request
2018-10-31 10:08:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330595   8 58422 36493029 A  ERROR'
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:08:13 [DEBUG   ] spawn_process: at 2018-10-31 10:08:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:08:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:08:24 [DEBUG   ] Got command BAM from MCS: ref #330596
2018-10-31 10:08:24 [INFO    ] Finished processing BAM request
2018-10-31 10:08:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330596   8 58422 36504033 A  ERROR'
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:08:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:08:24 [DEBUG   ] spawn_process: at 2018-10-31 10:08:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:08:35 [DEBUG   ] Got command BAM from MCS: ref #330597
2018-10-31 10:08:35 [INFO    ] Finished processing BAM request
2018-10-31 10:08:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330597   8 58422 36515033 A  ERROR'
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:08:35 [DEBUG   ] spawn_process: at 2018-10-31 10:08:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:08:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-31 10:08:46 [DEBUG   ] Got command BAM from MCS: ref #330598
2018-10-31 10:08:46 [INFO    ] Finished processing BAM request
2018-10-31 10:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330598   8 58422 36526033 A  ERROR'
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:08:46 [DEBUG   ] spawn_process: at 2018-10-31 10:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:08:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:08:57 [DEBUG   ] Got command BAM from MCS: ref #330599
2018-10-31 10:08:57 [INFO    ] Finished processing BAM request
2018-10-31 10:08:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330599   8 58422 36537029 A  ERROR'
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:08:57 [DEBUG   ] spawn_process: at 2018-10-31 10:08:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:08:58 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-10-31 10:09:08 [DEBUG   ] Got command BAM from MCS: ref #330600
2018-10-31 10:09:08 [INFO    ] Finished processing BAM request
2018-10-31 10:09:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330600   8 58422 36548029 A  ERROR'
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:09:08 [DEBUG   ] spawn_process: at 2018-10-31 10:09:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:09:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:09:19 [DEBUG   ] Got command BAM from MCS: ref #330601
2018-10-31 10:09:19 [INFO    ] Finished processing BAM request
2018-10-31 10:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330601   8 58422 36559025 A  ERROR'
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:09:19 [DEBUG   ] spawn_process: at 2018-10-31 10:09:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:09:30 [DEBUG   ] Got command BAM from MCS: ref #330602
2018-10-31 10:09:30 [INFO    ] Finished processing BAM request
2018-10-31 10:09:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330602   8 58422 36570033 A  ERROR'
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:09:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:09:30 [DEBUG   ] spawn_process: at 2018-10-31 10:09:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:09:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:09:41 [DEBUG   ] Got command BAM from MCS: ref #330603
2018-10-31 10:09:41 [INFO    ] Finished processing BAM request
2018-10-31 10:09:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330603   8 58422 36581029 A  ERROR'
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:09:41 [DEBUG   ] spawn_process: at 2018-10-31 10:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:09:52 [DEBUG   ] Got command BAM from MCS: ref #330604
2018-10-31 10:09:52 [INFO    ] Finished processing BAM request
2018-10-31 10:09:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330604   8 58422 36592033 A  ERROR'
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:09:52 [DEBUG   ] spawn_process: at 2018-10-31 10:09:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:09:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-31 10:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:09:58 [DEBUG   ] Finished updating board flags in 0.971 seconds
2018-10-31 10:10:03 [DEBUG   ] Got command BAM from MCS: ref #330609
2018-10-31 10:10:03 [INFO    ] Finished processing BAM request
2018-10-31 10:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330609   8 58422 36603025 A  ERROR'
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:10:03 [DEBUG   ] spawn_process: at 2018-10-31 10:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:10:14 [DEBUG   ] Got command BAM from MCS: ref #330610
2018-10-31 10:10:14 [INFO    ] Finished processing BAM request
2018-10-31 10:10:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330610   8 58422 36614029 A  ERROR'
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:10:14 [DEBUG   ] spawn_process: at 2018-10-31 10:10:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:10:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:10:25 [DEBUG   ] Got command BAM from MCS: ref #330611
2018-10-31 10:10:25 [INFO    ] Finished processing BAM request
2018-10-31 10:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330611   8 58422 36625033 A  ERROR'
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:10:25 [DEBUG   ] spawn_process: at 2018-10-31 10:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:10:35 [DEBUG   ] Got command RPT from MCS: ref #330613
2018-10-31 10:10:35 [DEBUG   ] summary = ERROR
2018-10-31 10:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330613  13 58422 36635089 A  ERRORERROR'
2018-10-31 10:10:35 [DEBUG   ] Got command RPT from MCS: ref #330614
2018-10-31 10:10:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330614  77 58422 36635293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:10:35 [DEBUG   ] Got command RPT from MCS: ref #330615
2018-10-31 10:10:35 [DEBUG   ] summary = ERROR
2018-10-31 10:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330615  13 58422 36635497 A  ERRORERROR'
2018-10-31 10:10:35 [DEBUG   ] Got command RPT from MCS: ref #330616
2018-10-31 10:10:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330616  77 58422 36635689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:10:35 [DEBUG   ] Got command RPT from MCS: ref #330617
2018-10-31 10:10:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330617  12 58422 36635893 A  ERRORB'
2018-10-31 10:10:36 [DEBUG   ] Got command BAM from MCS: ref #330612
2018-10-31 10:10:36 [INFO    ] Finished processing BAM request
2018-10-31 10:10:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330612   8 58422 36636029 A  ERROR'
2018-10-31 10:10:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:10:36 [DEBUG   ] spawn_process: at 2018-10-31 10:10:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:10:40 [DEBUG   ] Got command RPT from MCS: ref #330618
2018-10-31 10:10:40 [DEBUG   ] summary = ERROR
2018-10-31 10:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330618  13 58422 36640129 A  ERRORERROR'
2018-10-31 10:10:40 [DEBUG   ] Got command RPT from MCS: ref #330619
2018-10-31 10:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330619  77 58422 36640130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:10:47 [DEBUG   ] Got command BAM from MCS: ref #330635
2018-10-31 10:10:47 [INFO    ] Finished processing BAM request
2018-10-31 10:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330635   8 58422 36647025 A  ERROR'
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:10:47 [DEBUG   ] spawn_process: at 2018-10-31 10:10:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:10:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:10:58 [DEBUG   ] Got command BAM from MCS: ref #330636
2018-10-31 10:10:58 [INFO    ] Finished processing BAM request
2018-10-31 10:10:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330636   8 58422 36658029 A  ERROR'
2018-10-31 10:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:10:58 [DEBUG   ] spawn_process: at 2018-10-31 10:10:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:10:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:10:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:10:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:10:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:10:59 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-31 10:11:09 [DEBUG   ] Got command BAM from MCS: ref #330637
2018-10-31 10:11:09 [INFO    ] Finished processing BAM request
2018-10-31 10:11:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:11:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330637   8 58422 36669029 A  ERROR'
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:11:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:11:09 [DEBUG   ] spawn_process: at 2018-10-31 10:11:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:11:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:11:20 [DEBUG   ] Got command BAM from MCS: ref #330638
2018-10-31 10:11:20 [INFO    ] Finished processing BAM request
2018-10-31 10:11:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330638   8 58422 36680029 A  ERROR'
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:11:20 [DEBUG   ] spawn_process: at 2018-10-31 10:11:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:11:31 [DEBUG   ] Got command BAM from MCS: ref #330639
2018-10-31 10:11:31 [INFO    ] Finished processing BAM request
2018-10-31 10:11:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330639   8 58422 36691033 A  ERROR'
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:11:31 [DEBUG   ] spawn_process: at 2018-10-31 10:11:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:11:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:11:42 [DEBUG   ] Got command BAM from MCS: ref #330640
2018-10-31 10:11:42 [INFO    ] Finished processing BAM request
2018-10-31 10:11:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330640   8 58422 36702029 A  ERROR'
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:11:42 [DEBUG   ] spawn_process: at 2018-10-31 10:11:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:11:53 [DEBUG   ] Got command BAM from MCS: ref #330641
2018-10-31 10:11:53 [INFO    ] Finished processing BAM request
2018-10-31 10:11:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330641   8 58422 36713041 A  ERROR'
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:11:53 [DEBUG   ] spawn_process: at 2018-10-31 10:11:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:11:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:11:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:11:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:11:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:11:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:11:59 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-31 10:12:04 [DEBUG   ] Got command BAM from MCS: ref #330642
2018-10-31 10:12:04 [INFO    ] Finished processing BAM request
2018-10-31 10:12:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:12:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330642   8 58422 36724025 A  ERROR'
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:12:04 [DEBUG   ] spawn_process: at 2018-10-31 10:12:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:12:15 [DEBUG   ] Got command BAM from MCS: ref #330643
2018-10-31 10:12:15 [INFO    ] Finished processing BAM request
2018-10-31 10:12:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330643   8 58422 36735025 A  ERROR'
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:12:15 [DEBUG   ] spawn_process: at 2018-10-31 10:12:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:12:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-31 10:12:26 [DEBUG   ] Got command BAM from MCS: ref #330644
2018-10-31 10:12:26 [INFO    ] Finished processing BAM request
2018-10-31 10:12:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330644   8 58422 36746029 A  ERROR'
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:12:26 [DEBUG   ] spawn_process: at 2018-10-31 10:12:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:12:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:12:37 [DEBUG   ] Got command BAM from MCS: ref #330645
2018-10-31 10:12:37 [INFO    ] Finished processing BAM request
2018-10-31 10:12:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330645   8 58422 36757025 A  ERROR'
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:12:37 [DEBUG   ] spawn_process: at 2018-10-31 10:12:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:12:48 [DEBUG   ] Got command BAM from MCS: ref #330646
2018-10-31 10:12:48 [INFO    ] Finished processing BAM request
2018-10-31 10:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330646   8 58422 36768025 A  ERROR'
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:12:48 [DEBUG   ] spawn_process: at 2018-10-31 10:12:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:12:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:12:59 [DEBUG   ] Got command BAM from MCS: ref #330651
2018-10-31 10:12:59 [INFO    ] Finished processing BAM request
2018-10-31 10:12:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:12:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330651   8 58422 36779029 A  ERROR'
2018-10-31 10:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:12:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:12:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:12:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:12:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:12:59 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:12:59 [DEBUG   ] spawn_process: at 2018-10-31 10:12:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:13:10 [DEBUG   ] Got command BAM from MCS: ref #330652
2018-10-31 10:13:10 [INFO    ] Finished processing BAM request
2018-10-31 10:13:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330652   8 58422 36790037 A  ERROR'
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:13:10 [DEBUG   ] spawn_process: at 2018-10-31 10:13:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:13:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 10:13:21 [DEBUG   ] Got command BAM from MCS: ref #330653
2018-10-31 10:13:21 [INFO    ] Finished processing BAM request
2018-10-31 10:13:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330653   8 58422 36801037 A  ERROR'
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:13:21 [DEBUG   ] spawn_process: at 2018-10-31 10:13:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:13:32 [DEBUG   ] Got command BAM from MCS: ref #330654
2018-10-31 10:13:32 [INFO    ] Finished processing BAM request
2018-10-31 10:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330654   8 58422 36812037 A  ERROR'
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:13:32 [DEBUG   ] spawn_process: at 2018-10-31 10:13:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:13:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:13:43 [DEBUG   ] Got command BAM from MCS: ref #330655
2018-10-31 10:13:43 [INFO    ] Finished processing BAM request
2018-10-31 10:13:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330655   8 58422 36823033 A  ERROR'
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:13:43 [DEBUG   ] spawn_process: at 2018-10-31 10:13:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:13:54 [DEBUG   ] Got command BAM from MCS: ref #330656
2018-10-31 10:13:54 [INFO    ] Finished processing BAM request
2018-10-31 10:13:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330656   8 58422 36834025 A  ERROR'
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:13:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:13:54 [DEBUG   ] spawn_process: at 2018-10-31 10:13:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:13:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:13:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:13:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:13:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:13:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:13:59 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-10-31 10:14:05 [DEBUG   ] Got command BAM from MCS: ref #330657
2018-10-31 10:14:05 [INFO    ] Finished processing BAM request
2018-10-31 10:14:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330657   8 58422 36845025 A  ERROR'
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:14:05 [DEBUG   ] spawn_process: at 2018-10-31 10:14:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:14:16 [DEBUG   ] Got command BAM from MCS: ref #330658
2018-10-31 10:14:16 [INFO    ] Finished processing BAM request
2018-10-31 10:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330658   8 58422 36856025 A  ERROR'
2018-10-31 10:14:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:14:16 [DEBUG   ] spawn_process: at 2018-10-31 10:14:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:14:27 [DEBUG   ] Got command BAM from MCS: ref #330659
2018-10-31 10:14:27 [INFO    ] Finished processing BAM request
2018-10-31 10:14:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330659   8 58422 36867025 A  ERROR'
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:14:27 [DEBUG   ] spawn_process: at 2018-10-31 10:14:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:14:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:14:38 [DEBUG   ] Got command BAM from MCS: ref #330660
2018-10-31 10:14:38 [INFO    ] Finished processing BAM request
2018-10-31 10:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330660   8 58422 36878033 A  ERROR'
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:14:38 [DEBUG   ] spawn_process: at 2018-10-31 10:14:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:14:49 [DEBUG   ] Got command BAM from MCS: ref #330661
2018-10-31 10:14:49 [INFO    ] Finished processing BAM request
2018-10-31 10:14:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330661   8 58422 36889033 A  ERROR'
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:14:49 [DEBUG   ] spawn_process: at 2018-10-31 10:14:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:14:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:14:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:14:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:14:59 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-31 10:15:00 [DEBUG   ] Got command BAM from MCS: ref #330662
2018-10-31 10:15:00 [INFO    ] Finished processing BAM request
2018-10-31 10:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330662   8 58422 36900037 A  ERROR'
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:15:00 [DEBUG   ] spawn_process: at 2018-10-31 10:15:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:15:11 [DEBUG   ] Got command BAM from MCS: ref #330665
2018-10-31 10:15:11 [INFO    ] Finished processing BAM request
2018-10-31 10:15:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330665   8 58422 36911033 A  ERROR'
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:15:11 [DEBUG   ] spawn_process: at 2018-10-31 10:15:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:15:16 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 10:15:22 [DEBUG   ] Got command BAM from MCS: ref #330666
2018-10-31 10:15:22 [INFO    ] Finished processing BAM request
2018-10-31 10:15:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:15:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330666   8 58422 36922029 A  ERROR'
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:15:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:15:22 [DEBUG   ] spawn_process: at 2018-10-31 10:15:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:15:33 [DEBUG   ] Got command BAM from MCS: ref #330667
2018-10-31 10:15:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:15:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330667   8 58422 36933045 A  ERROR'
2018-10-31 10:15:33 [INFO    ] Finished processing BAM request
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:15:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:15:33 [DEBUG   ] spawn_process: at 2018-10-31 10:15:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:15:35 [DEBUG   ] Got command RPT from MCS: ref #330668
2018-10-31 10:15:35 [DEBUG   ] summary = ERROR
2018-10-31 10:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330668  13 58422 36935181 A  ERRORERROR'
2018-10-31 10:15:35 [DEBUG   ] Got command RPT from MCS: ref #330669
2018-10-31 10:15:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330669  77 58422 36935373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:15:35 [DEBUG   ] Got command RPT from MCS: ref #330670
2018-10-31 10:15:35 [DEBUG   ] summary = ERROR
2018-10-31 10:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330670  13 58422 36935577 A  ERRORERROR'
2018-10-31 10:15:35 [DEBUG   ] Got command RPT from MCS: ref #330672
2018-10-31 10:15:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330672  77 58422 36935781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:15:35 [DEBUG   ] Got command RPT from MCS: ref #330673
2018-10-31 10:15:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330673  12 58422 36935985 A  ERRORB'
2018-10-31 10:15:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:15:40 [DEBUG   ] Got command RPT from MCS: ref #330678
2018-10-31 10:15:40 [DEBUG   ] summary = ERROR
2018-10-31 10:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330678  13 58422 36940513 A  ERRORERROR'
2018-10-31 10:15:40 [DEBUG   ] Got command RPT from MCS: ref #330679
2018-10-31 10:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330679  77 58422 36940513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:15:45 [DEBUG   ] Got command BAM from MCS: ref #330695
2018-10-31 10:15:45 [INFO    ] Finished processing BAM request
2018-10-31 10:15:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330695   8 58422 36945030 A  ERROR'
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:15:45 [DEBUG   ] spawn_process: at 2018-10-31 10:15:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:15:57 [DEBUG   ] Got command BAM from MCS: ref #330700
2018-10-31 10:15:57 [INFO    ] Finished processing BAM request
2018-10-31 10:15:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330700   8 58422 36957034 A  ERROR'
2018-10-31 10:15:57 [DEBUG   ] Finished updating ant stats in 1.183 seconds
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:15:57 [DEBUG   ] spawn_process: at 2018-10-31 10:15:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:15:59 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-10-31 10:16:09 [DEBUG   ] Got command BAM from MCS: ref #330701
2018-10-31 10:16:09 [INFO    ] Finished processing BAM request
2018-10-31 10:16:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330701   8 58422 36969026 A  ERROR'
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:16:09 [DEBUG   ] spawn_process: at 2018-10-31 10:16:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:16:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 10:16:21 [DEBUG   ] Got command BAM from MCS: ref #330702
2018-10-31 10:16:21 [INFO    ] Finished processing BAM request
2018-10-31 10:16:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330702   8 58422 36981030 A  ERROR'
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:16:21 [DEBUG   ] spawn_process: at 2018-10-31 10:16:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:16:33 [DEBUG   ] Got command BAM from MCS: ref #330703
2018-10-31 10:16:33 [INFO    ] Finished processing BAM request
2018-10-31 10:16:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330703   8 58422 36993033 A  ERROR'
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:16:33 [DEBUG   ] spawn_process: at 2018-10-31 10:16:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:16:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 10:16:45 [DEBUG   ] Got command BAM from MCS: ref #330704
2018-10-31 10:16:45 [INFO    ] Finished processing BAM request
2018-10-31 10:16:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330704   8 58422 37005025 A  ERROR'
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:16:45 [DEBUG   ] spawn_process: at 2018-10-31 10:16:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:16:57 [DEBUG   ] Got command BAM from MCS: ref #330705
2018-10-31 10:16:57 [INFO    ] Finished processing BAM request
2018-10-31 10:16:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330705   8 58422 37017033 A  ERROR'
2018-10-31 10:16:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:16:57 [DEBUG   ] spawn_process: at 2018-10-31 10:16:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-31 10:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:16:59 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-10-31 10:17:09 [DEBUG   ] Got command BAM from MCS: ref #330706
2018-10-31 10:17:09 [INFO    ] Finished processing BAM request
2018-10-31 10:17:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330706   8 58422 37029029 A  ERROR'
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:17:09 [DEBUG   ] spawn_process: at 2018-10-31 10:17:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:17:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:17:21 [DEBUG   ] Got command BAM from MCS: ref #330707
2018-10-31 10:17:21 [INFO    ] Finished processing BAM request
2018-10-31 10:17:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330707   8 58422 37041025 A  ERROR'
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:17:21 [DEBUG   ] spawn_process: at 2018-10-31 10:17:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:17:33 [DEBUG   ] Got command BAM from MCS: ref #330708
2018-10-31 10:17:33 [INFO    ] Finished processing BAM request
2018-10-31 10:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330708   8 58422 37053029 A  ERROR'
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:17:33 [DEBUG   ] spawn_process: at 2018-10-31 10:17:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:17:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 10:17:45 [DEBUG   ] Got command BAM from MCS: ref #330709
2018-10-31 10:17:45 [INFO    ] Finished processing BAM request
2018-10-31 10:17:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:17:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330709   8 58422 37065033 A  ERROR'
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:17:45 [DEBUG   ] spawn_process: at 2018-10-31 10:17:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:17:57 [DEBUG   ] Got command BAM from MCS: ref #330710
2018-10-31 10:17:57 [INFO    ] Finished processing BAM request
2018-10-31 10:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330710   8 58422 37077025 A  ERROR'
2018-10-31 10:17:57 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:17:57 [DEBUG   ] spawn_process: at 2018-10-31 10:17:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-31 10:17:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:17:59 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-10-31 10:18:09 [DEBUG   ] Got command BAM from MCS: ref #330711
2018-10-31 10:18:09 [INFO    ] Finished processing BAM request
2018-10-31 10:18:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:18:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330711   8 58422 37089025 A  ERROR'
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:18:09 [DEBUG   ] spawn_process: at 2018-10-31 10:18:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:18:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:18:21 [DEBUG   ] Got command BAM from MCS: ref #330712
2018-10-31 10:18:21 [INFO    ] Finished processing BAM request
2018-10-31 10:18:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330712   8 58422 37101029 A  ERROR'
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:18:21 [DEBUG   ] spawn_process: at 2018-10-31 10:18:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:18:33 [DEBUG   ] Got command BAM from MCS: ref #330713
2018-10-31 10:18:33 [INFO    ] Finished processing BAM request
2018-10-31 10:18:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330713   8 58422 37113033 A  ERROR'
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:18:33 [DEBUG   ] spawn_process: at 2018-10-31 10:18:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:18:37 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 10:18:45 [DEBUG   ] Got command BAM from MCS: ref #330714
2018-10-31 10:18:45 [INFO    ] Finished processing BAM request
2018-10-31 10:18:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330714   8 58422 37125025 A  ERROR'
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:18:45 [DEBUG   ] spawn_process: at 2018-10-31 10:18:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:18:57 [DEBUG   ] Got command BAM from MCS: ref #330719
2018-10-31 10:18:57 [INFO    ] Finished processing BAM request
2018-10-31 10:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330719   8 58422 37137029 A  ERROR'
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:18:57 [DEBUG   ] spawn_process: at 2018-10-31 10:18:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:18:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:18:59 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-10-31 10:19:09 [DEBUG   ] Got command BAM from MCS: ref #330720
2018-10-31 10:19:09 [INFO    ] Finished processing BAM request
2018-10-31 10:19:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330720   8 58422 37149025 A  ERROR'
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:19:09 [DEBUG   ] spawn_process: at 2018-10-31 10:19:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:19:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:19:21 [DEBUG   ] Got command BAM from MCS: ref #330721
2018-10-31 10:19:21 [INFO    ] Finished processing BAM request
2018-10-31 10:19:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330721   8 58422 37161025 A  ERROR'
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:19:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:19:21 [DEBUG   ] spawn_process: at 2018-10-31 10:19:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:19:33 [DEBUG   ] Got command BAM from MCS: ref #330722
2018-10-31 10:19:33 [INFO    ] Finished processing BAM request
2018-10-31 10:19:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330722   8 58422 37173033 A  ERROR'
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:19:33 [DEBUG   ] spawn_process: at 2018-10-31 10:19:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:19:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 10:19:45 [DEBUG   ] Got command BAM from MCS: ref #330723
2018-10-31 10:19:45 [INFO    ] Finished processing BAM request
2018-10-31 10:19:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330723   8 58422 37185025 A  ERROR'
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:19:45 [DEBUG   ] spawn_process: at 2018-10-31 10:19:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:19:57 [DEBUG   ] Got command BAM from MCS: ref #330724
2018-10-31 10:19:57 [INFO    ] Finished processing BAM request
2018-10-31 10:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330724   8 58422 37197029 A  ERROR'
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:19:57 [DEBUG   ] spawn_process: at 2018-10-31 10:19:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:19:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:19:59 [DEBUG   ] Finished updating board flags in 1.259 seconds
2018-10-31 10:20:09 [DEBUG   ] Got command BAM from MCS: ref #330725
2018-10-31 10:20:09 [INFO    ] Finished processing BAM request
2018-10-31 10:20:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330725   8 58422 37209025 A  ERROR'
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:20:09 [DEBUG   ] spawn_process: at 2018-10-31 10:20:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:20:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:20:21 [DEBUG   ] Got command BAM from MCS: ref #330726
2018-10-31 10:20:21 [INFO    ] Finished processing BAM request
2018-10-31 10:20:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:20:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330726   8 58422 37221033 A  ERROR'
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:20:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:20:21 [DEBUG   ] spawn_process: at 2018-10-31 10:20:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:20:33 [DEBUG   ] Got command BAM from MCS: ref #330727
2018-10-31 10:20:33 [INFO    ] Finished processing BAM request
2018-10-31 10:20:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330727   8 58422 37233029 A  ERROR'
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:20:33 [DEBUG   ] spawn_process: at 2018-10-31 10:20:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:20:35 [DEBUG   ] Got command RPT from MCS: ref #330728
2018-10-31 10:20:35 [DEBUG   ] summary = ERROR
2018-10-31 10:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330728  13 58422 37235261 A  ERRORERROR'
2018-10-31 10:20:35 [DEBUG   ] Got command RPT from MCS: ref #330729
2018-10-31 10:20:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330729  77 58422 37235465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:20:35 [DEBUG   ] Got command RPT from MCS: ref #330730
2018-10-31 10:20:35 [DEBUG   ] summary = ERROR
2018-10-31 10:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330730  13 58422 37235669 A  ERRORERROR'
2018-10-31 10:20:35 [DEBUG   ] Got command RPT from MCS: ref #330731
2018-10-31 10:20:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330731  77 58422 37235861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:20:36 [DEBUG   ] Got command RPT from MCS: ref #330732
2018-10-31 10:20:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:20:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330732  12 58422 37236065 A  ERRORB'
2018-10-31 10:20:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:20:40 [DEBUG   ] Got command RPT from MCS: ref #330733
2018-10-31 10:20:40 [DEBUG   ] summary = ERROR
2018-10-31 10:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330733  13 58422 37240133 A  ERRORERROR'
2018-10-31 10:20:40 [DEBUG   ] Got command RPT from MCS: ref #330734
2018-10-31 10:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330734  77 58422 37240134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:20:45 [DEBUG   ] Got command BAM from MCS: ref #330750
2018-10-31 10:20:45 [INFO    ] Finished processing BAM request
2018-10-31 10:20:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330750   8 58422 37245033 A  ERROR'
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:20:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:20:45 [DEBUG   ] spawn_process: at 2018-10-31 10:20:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:20:57 [DEBUG   ] Got command BAM from MCS: ref #330751
2018-10-31 10:20:57 [INFO    ] Finished processing BAM request
2018-10-31 10:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330751   8 58422 37257025 A  ERROR'
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:20:57 [DEBUG   ] spawn_process: at 2018-10-31 10:20:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:20:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-31 10:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:20:59 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-10-31 10:21:09 [DEBUG   ] Got command BAM from MCS: ref #330752
2018-10-31 10:21:09 [INFO    ] Finished processing BAM request
2018-10-31 10:21:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:21:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330752   8 58422 37269033 A  ERROR'
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:21:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:21:09 [DEBUG   ] spawn_process: at 2018-10-31 10:21:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:21:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:21:21 [DEBUG   ] Got command BAM from MCS: ref #330753
2018-10-31 10:21:21 [INFO    ] Finished processing BAM request
2018-10-31 10:21:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330753   8 58422 37281029 A  ERROR'
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:21:21 [DEBUG   ] spawn_process: at 2018-10-31 10:21:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:21:33 [DEBUG   ] Got command BAM from MCS: ref #330754
2018-10-31 10:21:33 [INFO    ] Finished processing BAM request
2018-10-31 10:21:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330754   8 58422 37293025 A  ERROR'
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:21:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:21:33 [DEBUG   ] spawn_process: at 2018-10-31 10:21:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:21:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:21:45 [DEBUG   ] Got command BAM from MCS: ref #330755
2018-10-31 10:21:45 [INFO    ] Finished processing BAM request
2018-10-31 10:21:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330755   8 58422 37305025 A  ERROR'
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:21:45 [DEBUG   ] spawn_process: at 2018-10-31 10:21:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:21:57 [DEBUG   ] Got command BAM from MCS: ref #330760
2018-10-31 10:21:57 [INFO    ] Finished processing BAM request
2018-10-31 10:21:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330760   8 58422 37317033 A  ERROR'
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:21:57 [DEBUG   ] spawn_process: at 2018-10-31 10:21:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:21:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:21:59 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-10-31 10:22:09 [DEBUG   ] Got command BAM from MCS: ref #330761
2018-10-31 10:22:09 [INFO    ] Finished processing BAM request
2018-10-31 10:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330761   8 58422 37329033 A  ERROR'
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:22:09 [DEBUG   ] spawn_process: at 2018-10-31 10:22:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:22:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:22:21 [DEBUG   ] Got command BAM from MCS: ref #330762
2018-10-31 10:22:21 [INFO    ] Finished processing BAM request
2018-10-31 10:22:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330762   8 58422 37341025 A  ERROR'
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:22:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:22:21 [DEBUG   ] spawn_process: at 2018-10-31 10:22:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:22:33 [DEBUG   ] Got command BAM from MCS: ref #330763
2018-10-31 10:22:33 [INFO    ] Finished processing BAM request
2018-10-31 10:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330763   8 58422 37353029 A  ERROR'
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:22:33 [DEBUG   ] spawn_process: at 2018-10-31 10:22:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:22:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:22:45 [DEBUG   ] Got command BAM from MCS: ref #330764
2018-10-31 10:22:45 [INFO    ] Finished processing BAM request
2018-10-31 10:22:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:22:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330764   8 58422 37365033 A  ERROR'
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:22:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:22:45 [DEBUG   ] spawn_process: at 2018-10-31 10:22:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:22:57 [DEBUG   ] Got command BAM from MCS: ref #330765
2018-10-31 10:22:57 [INFO    ] Finished processing BAM request
2018-10-31 10:22:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:22:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330765   8 58422 37377033 A  ERROR'
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:22:57 [DEBUG   ] spawn_process: at 2018-10-31 10:22:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:22:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 10:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:22:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:22:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:22:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:22:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:22:59 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-10-31 10:23:09 [DEBUG   ] Got command BAM from MCS: ref #330766
2018-10-31 10:23:09 [INFO    ] Finished processing BAM request
2018-10-31 10:23:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:23:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330766   8 58422 37389029 A  ERROR'
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:23:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:23:09 [DEBUG   ] spawn_process: at 2018-10-31 10:23:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:23:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:23:21 [DEBUG   ] Got command BAM from MCS: ref #330767
2018-10-31 10:23:21 [INFO    ] Finished processing BAM request
2018-10-31 10:23:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330767   8 58422 37401029 A  ERROR'
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:23:21 [DEBUG   ] spawn_process: at 2018-10-31 10:23:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:23:33 [DEBUG   ] Got command BAM from MCS: ref #330768
2018-10-31 10:23:33 [INFO    ] Finished processing BAM request
2018-10-31 10:23:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330768   8 58422 37413025 A  ERROR'
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:23:33 [DEBUG   ] spawn_process: at 2018-10-31 10:23:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:23:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 10:23:45 [DEBUG   ] Got command BAM from MCS: ref #330769
2018-10-31 10:23:45 [INFO    ] Finished processing BAM request
2018-10-31 10:23:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330769   8 58422 37425033 A  ERROR'
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:23:45 [DEBUG   ] spawn_process: at 2018-10-31 10:23:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:23:57 [DEBUG   ] Got command BAM from MCS: ref #330770
2018-10-31 10:23:57 [INFO    ] Finished processing BAM request
2018-10-31 10:23:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330770   8 58422 37437025 A  ERROR'
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:23:57 [DEBUG   ] spawn_process: at 2018-10-31 10:23:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:23:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:23:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:23:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:23:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:23:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:23:59 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-10-31 10:24:09 [DEBUG   ] Got command BAM from MCS: ref #330771
2018-10-31 10:24:09 [INFO    ] Finished processing BAM request
2018-10-31 10:24:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330771   8 58422 37449025 A  ERROR'
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:24:09 [DEBUG   ] spawn_process: at 2018-10-31 10:24:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:24:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:24:21 [DEBUG   ] Got command BAM from MCS: ref #330772
2018-10-31 10:24:21 [INFO    ] Finished processing BAM request
2018-10-31 10:24:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330772   8 58422 37461029 A  ERROR'
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:24:21 [DEBUG   ] spawn_process: at 2018-10-31 10:24:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:24:33 [DEBUG   ] Got command BAM from MCS: ref #330773
2018-10-31 10:24:33 [INFO    ] Finished processing BAM request
2018-10-31 10:24:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330773   8 58422 37473033 A  ERROR'
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:24:33 [DEBUG   ] spawn_process: at 2018-10-31 10:24:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:24:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:24:45 [DEBUG   ] Got command BAM from MCS: ref #330774
2018-10-31 10:24:45 [INFO    ] Finished processing BAM request
2018-10-31 10:24:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330774   8 58422 37485026 A  ERROR'
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:24:45 [DEBUG   ] spawn_process: at 2018-10-31 10:24:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:24:57 [DEBUG   ] Got command BAM from MCS: ref #330779
2018-10-31 10:24:57 [INFO    ] Finished processing BAM request
2018-10-31 10:24:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330779   8 58422 37497030 A  ERROR'
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:24:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:24:57 [DEBUG   ] spawn_process: at 2018-10-31 10:24:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:24:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:24:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:24:59 [WARNING ] (13, 1, 'bot')
2018-10-31 10:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:24:59 [DEBUG   ] Finished updating board flags in 0.961 seconds
2018-10-31 10:25:09 [DEBUG   ] Got command BAM from MCS: ref #330782
2018-10-31 10:25:09 [INFO    ] Finished processing BAM request
2018-10-31 10:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330782   8 58422 37509029 A  ERROR'
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:25:09 [DEBUG   ] spawn_process: at 2018-10-31 10:25:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:25:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:25:21 [DEBUG   ] Got command BAM from MCS: ref #330783
2018-10-31 10:25:21 [INFO    ] Finished processing BAM request
2018-10-31 10:25:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330783   8 58422 37521025 A  ERROR'
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:25:21 [DEBUG   ] spawn_process: at 2018-10-31 10:25:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:25:33 [DEBUG   ] Got command BAM from MCS: ref #330784
2018-10-31 10:25:33 [INFO    ] Finished processing BAM request
2018-10-31 10:25:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330784   8 58422 37533025 A  ERROR'
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:25:33 [DEBUG   ] spawn_process: at 2018-10-31 10:25:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:25:35 [DEBUG   ] Got command RPT from MCS: ref #330785
2018-10-31 10:25:35 [DEBUG   ] summary = ERROR
2018-10-31 10:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330785  13 58422 37535346 A  ERRORERROR'
2018-10-31 10:25:35 [DEBUG   ] Got command RPT from MCS: ref #330786
2018-10-31 10:25:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330786  77 58422 37535549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:25:35 [DEBUG   ] Got command RPT from MCS: ref #330787
2018-10-31 10:25:35 [DEBUG   ] summary = ERROR
2018-10-31 10:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330787  13 58422 37535753 A  ERRORERROR'
2018-10-31 10:25:35 [DEBUG   ] Got command RPT from MCS: ref #330789
2018-10-31 10:25:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330789  77 58422 37535946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:25:36 [DEBUG   ] Got command RPT from MCS: ref #330791
2018-10-31 10:25:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330791  12 58422 37536149 A  ERRORB'
2018-10-31 10:25:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:25:40 [DEBUG   ] Got command RPT from MCS: ref #330795
2018-10-31 10:25:40 [DEBUG   ] summary = ERROR
2018-10-31 10:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330795  13 58422 37540133 A  ERRORERROR'
2018-10-31 10:25:40 [DEBUG   ] Got command RPT from MCS: ref #330796
2018-10-31 10:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330796  77 58422 37540134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:25:45 [DEBUG   ] Got command BAM from MCS: ref #330812
2018-10-31 10:25:45 [INFO    ] Finished processing BAM request
2018-10-31 10:25:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330812   8 58422 37545034 A  ERROR'
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:25:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:25:45 [DEBUG   ] spawn_process: at 2018-10-31 10:25:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:25:57 [DEBUG   ] Got command BAM from MCS: ref #330813
2018-10-31 10:25:57 [INFO    ] Finished processing BAM request
2018-10-31 10:25:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:25:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330813   8 58422 37557026 A  ERROR'
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:25:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:25:57 [DEBUG   ] spawn_process: at 2018-10-31 10:25:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:25:58 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 10:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:26:00 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-31 10:26:09 [DEBUG   ] Got command BAM from MCS: ref #330814
2018-10-31 10:26:09 [INFO    ] Finished processing BAM request
2018-10-31 10:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330814   8 58422 37569030 A  ERROR'
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:26:09 [DEBUG   ] spawn_process: at 2018-10-31 10:26:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:26:19 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2018-10-31 10:26:21 [DEBUG   ] Got command BAM from MCS: ref #330815
2018-10-31 10:26:21 [INFO    ] Finished processing BAM request
2018-10-31 10:26:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330815   8 58422 37581034 A  ERROR'
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:26:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:26:21 [DEBUG   ] spawn_process: at 2018-10-31 10:26:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:26:33 [DEBUG   ] Got command BAM from MCS: ref #330816
2018-10-31 10:26:33 [INFO    ] Finished processing BAM request
2018-10-31 10:26:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330816   8 58422 37593026 A  ERROR'
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:26:33 [DEBUG   ] spawn_process: at 2018-10-31 10:26:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:26:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:26:46 [DEBUG   ] Got command BAM from MCS: ref #330817
2018-10-31 10:26:46 [INFO    ] Finished processing BAM request
2018-10-31 10:26:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330817   8 58422 37606026 A  ERROR'
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:26:46 [DEBUG   ] spawn_process: at 2018-10-31 10:26:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:26:59 [DEBUG   ] Got command BAM from MCS: ref #330818
2018-10-31 10:26:59 [INFO    ] Finished processing BAM request
2018-10-31 10:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330818   8 58422 37619026 A  ERROR'
2018-10-31 10:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:26:59 [DEBUG   ] Finished updating ant stats in 1.037 seconds
2018-10-31 10:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:26:59 [DEBUG   ] spawn_process: at 2018-10-31 10:26:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:27:00 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-31 10:27:12 [DEBUG   ] Got command BAM from MCS: ref #330819
2018-10-31 10:27:12 [INFO    ] Finished processing BAM request
2018-10-31 10:27:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330819   8 58422 37632033 A  ERROR'
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:27:12 [DEBUG   ] spawn_process: at 2018-10-31 10:27:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:27:19 [DEBUG   ] Finished updating ant stats in 0.966 seconds
2018-10-31 10:27:25 [DEBUG   ] Got command BAM from MCS: ref #330820
2018-10-31 10:27:25 [INFO    ] Finished processing BAM request
2018-10-31 10:27:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330820   8 58422 37645029 A  ERROR'
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:27:25 [DEBUG   ] spawn_process: at 2018-10-31 10:27:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:27:38 [DEBUG   ] Got command BAM from MCS: ref #330821
2018-10-31 10:27:38 [INFO    ] Finished processing BAM request
2018-10-31 10:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330821   8 58422 37658033 A  ERROR'
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:27:38 [DEBUG   ] spawn_process: at 2018-10-31 10:27:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:27:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:27:51 [DEBUG   ] Got command BAM from MCS: ref #330822
2018-10-31 10:27:51 [INFO    ] Finished processing BAM request
2018-10-31 10:27:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:27:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330822   8 58422 37671029 A  ERROR'
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:27:51 [DEBUG   ] spawn_process: at 2018-10-31 10:27:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:27:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:28:00 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-10-31 10:28:04 [DEBUG   ] Got command BAM from MCS: ref #330827
2018-10-31 10:28:04 [INFO    ] Finished processing BAM request
2018-10-31 10:28:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330827   8 58422 37684029 A  ERROR'
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:28:04 [DEBUG   ] spawn_process: at 2018-10-31 10:28:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:28:17 [DEBUG   ] Got command BAM from MCS: ref #330828
2018-10-31 10:28:17 [INFO    ] Finished processing BAM request
2018-10-31 10:28:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330828   8 58422 37697025 A  ERROR'
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:28:17 [DEBUG   ] spawn_process: at 2018-10-31 10:28:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:28:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:28:30 [DEBUG   ] Got command BAM from MCS: ref #330829
2018-10-31 10:28:30 [INFO    ] Finished processing BAM request
2018-10-31 10:28:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330829   8 58422 37710025 A  ERROR'
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:28:30 [DEBUG   ] spawn_process: at 2018-10-31 10:28:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:28:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:28:43 [DEBUG   ] Got command BAM from MCS: ref #330830
2018-10-31 10:28:43 [INFO    ] Finished processing BAM request
2018-10-31 10:28:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330830   8 58422 37723025 A  ERROR'
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:28:43 [DEBUG   ] spawn_process: at 2018-10-31 10:28:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:28:56 [DEBUG   ] Got command BAM from MCS: ref #330831
2018-10-31 10:28:56 [INFO    ] Finished processing BAM request
2018-10-31 10:28:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330831   8 58422 37736033 A  ERROR'
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:28:56 [DEBUG   ] spawn_process: at 2018-10-31 10:28:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:28:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:29:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:29:00 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-31 10:29:09 [DEBUG   ] Got command BAM from MCS: ref #330832
2018-10-31 10:29:09 [INFO    ] Finished processing BAM request
2018-10-31 10:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330832   8 58422 37749029 A  ERROR'
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:29:09 [DEBUG   ] spawn_process: at 2018-10-31 10:29:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:29:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:29:22 [DEBUG   ] Got command BAM from MCS: ref #330833
2018-10-31 10:29:22 [INFO    ] Finished processing BAM request
2018-10-31 10:29:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330833   8 58422 37762033 A  ERROR'
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:29:22 [DEBUG   ] spawn_process: at 2018-10-31 10:29:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:29:35 [DEBUG   ] Got command BAM from MCS: ref #330834
2018-10-31 10:29:35 [INFO    ] Finished processing BAM request
2018-10-31 10:29:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330834   8 58422 37775033 A  ERROR'
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:29:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:29:35 [DEBUG   ] spawn_process: at 2018-10-31 10:29:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:29:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:29:48 [DEBUG   ] Got command BAM from MCS: ref #330835
2018-10-31 10:29:48 [INFO    ] Finished processing BAM request
2018-10-31 10:29:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330835   8 58422 37788025 A  ERROR'
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:29:48 [DEBUG   ] spawn_process: at 2018-10-31 10:29:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:29:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:30:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-31 10:30:01 [DEBUG   ] Got command BAM from MCS: ref #330836
2018-10-31 10:30:01 [INFO    ] Finished processing BAM request
2018-10-31 10:30:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330836   8 58422 37801025 A  ERROR'
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:30:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:30:01 [DEBUG   ] spawn_process: at 2018-10-31 10:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:30:14 [DEBUG   ] Got command BAM from MCS: ref #330837
2018-10-31 10:30:14 [INFO    ] Finished processing BAM request
2018-10-31 10:30:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330837   8 58422 37814025 A  ERROR'
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:30:14 [DEBUG   ] spawn_process: at 2018-10-31 10:30:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:30:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 10:30:27 [DEBUG   ] Got command BAM from MCS: ref #330838
2018-10-31 10:30:27 [INFO    ] Finished processing BAM request
2018-10-31 10:30:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330838   8 58422 37827034 A  ERROR'
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:30:27 [DEBUG   ] spawn_process: at 2018-10-31 10:30:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:30:35 [DEBUG   ] Got command RPT from MCS: ref #330839
2018-10-31 10:30:35 [DEBUG   ] summary = ERROR
2018-10-31 10:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330839  13 58422 37835434 A  ERRORERROR'
2018-10-31 10:30:35 [DEBUG   ] Got command RPT from MCS: ref #330840
2018-10-31 10:30:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330840  77 58422 37835637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:30:35 [DEBUG   ] Got command RPT from MCS: ref #330841
2018-10-31 10:30:35 [DEBUG   ] summary = ERROR
2018-10-31 10:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330841  13 58422 37835842 A  ERRORERROR'
2018-10-31 10:30:36 [DEBUG   ] Got command RPT from MCS: ref #330842
2018-10-31 10:30:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330842  77 58422 37836034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:30:36 [DEBUG   ] Got command RPT from MCS: ref #330843
2018-10-31 10:30:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330843  12 58422 37836237 A  ERRORB'
2018-10-31 10:30:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:30:40 [DEBUG   ] Got command BAM from MCS: ref #330844
2018-10-31 10:30:40 [INFO    ] Finished processing BAM request
2018-10-31 10:30:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330844   8 58422 37840037 A  ERROR'
2018-10-31 10:30:40 [DEBUG   ] Got command RPT from MCS: ref #330845
2018-10-31 10:30:40 [DEBUG   ] summary = ERROR
2018-10-31 10:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330845  13 58422 37840133 A  ERRORERROR'
2018-10-31 10:30:40 [DEBUG   ] Got command RPT from MCS: ref #330846
2018-10-31 10:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330846  77 58422 37840134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:30:40 [DEBUG   ] spawn_process: at 2018-10-31 10:30:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:30:53 [DEBUG   ] Got command BAM from MCS: ref #330862
2018-10-31 10:30:53 [INFO    ] Finished processing BAM request
2018-10-31 10:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330862   8 58422 37853029 A  ERROR'
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:30:53 [DEBUG   ] spawn_process: at 2018-10-31 10:30:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:30:59 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 10:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:31:00 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-10-31 10:31:06 [DEBUG   ] Got command BAM from MCS: ref #330867
2018-10-31 10:31:06 [INFO    ] Finished processing BAM request
2018-10-31 10:31:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330867   8 58422 37866029 A  ERROR'
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:31:06 [DEBUG   ] spawn_process: at 2018-10-31 10:31:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:31:19 [DEBUG   ] Got command BAM from MCS: ref #330868
2018-10-31 10:31:19 [INFO    ] Finished processing BAM request
2018-10-31 10:31:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330868   8 58422 37879029 A  ERROR'
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:31:19 [DEBUG   ] spawn_process: at 2018-10-31 10:31:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:31:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:31:32 [DEBUG   ] Got command BAM from MCS: ref #330869
2018-10-31 10:31:32 [INFO    ] Finished processing BAM request
2018-10-31 10:31:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330869   8 58422 37892033 A  ERROR'
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:31:32 [DEBUG   ] spawn_process: at 2018-10-31 10:31:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:31:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:31:45 [DEBUG   ] Got command BAM from MCS: ref #330870
2018-10-31 10:31:45 [INFO    ] Finished processing BAM request
2018-10-31 10:31:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330870   8 58422 37905033 A  ERROR'
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:31:45 [DEBUG   ] spawn_process: at 2018-10-31 10:31:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:31:58 [DEBUG   ] Got command BAM from MCS: ref #330871
2018-10-31 10:31:58 [INFO    ] Finished processing BAM request
2018-10-31 10:31:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330871   8 58422 37918025 A  ERROR'
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:31:58 [DEBUG   ] spawn_process: at 2018-10-31 10:31:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:32:00 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2018-10-31 10:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:32:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:32:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:32:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:32:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:32:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:32:01 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-31 10:32:11 [DEBUG   ] Got command BAM from MCS: ref #330872
2018-10-31 10:32:11 [INFO    ] Finished processing BAM request
2018-10-31 10:32:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330872   8 58422 37931029 A  ERROR'
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:32:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:32:11 [DEBUG   ] spawn_process: at 2018-10-31 10:32:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:32:20 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2018-10-31 10:32:24 [DEBUG   ] Got command BAM from MCS: ref #330873
2018-10-31 10:32:24 [INFO    ] Finished processing BAM request
2018-10-31 10:32:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330873   8 58422 37944025 A  ERROR'
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:32:24 [DEBUG   ] spawn_process: at 2018-10-31 10:32:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:32:37 [DEBUG   ] Got command BAM from MCS: ref #330874
2018-10-31 10:32:37 [INFO    ] Finished processing BAM request
2018-10-31 10:32:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330874   8 58422 37957025 A  ERROR'
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:32:37 [DEBUG   ] spawn_process: at 2018-10-31 10:32:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:32:40 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2018-10-31 10:32:50 [DEBUG   ] Got command BAM from MCS: ref #330875
2018-10-31 10:32:50 [INFO    ] Finished processing BAM request
2018-10-31 10:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330875   8 58422 37970025 A  ERROR'
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:32:50 [DEBUG   ] spawn_process: at 2018-10-31 10:32:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:33:00 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-10-31 10:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:33:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:33:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:33:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:33:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:33:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:33:01 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-31 10:33:03 [DEBUG   ] Got command BAM from MCS: ref #330876
2018-10-31 10:33:03 [INFO    ] Finished processing BAM request
2018-10-31 10:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330876   8 58422 37983029 A  ERROR'
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:33:03 [DEBUG   ] spawn_process: at 2018-10-31 10:33:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:33:16 [DEBUG   ] Got command BAM from MCS: ref #330877
2018-10-31 10:33:16 [INFO    ] Finished processing BAM request
2018-10-31 10:33:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330877   8 58422 37996029 A  ERROR'
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:33:16 [DEBUG   ] spawn_process: at 2018-10-31 10:33:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:33:20 [DEBUG   ] Finished updating ant stats in 0.767 seconds
2018-10-31 10:33:30 [DEBUG   ] Got command BAM from MCS: ref #330878
2018-10-31 10:33:30 [INFO    ] Finished processing BAM request
2018-10-31 10:33:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330878   8 58422 38010029 A  ERROR'
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:33:30 [DEBUG   ] spawn_process: at 2018-10-31 10:33:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:33:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 10:33:44 [DEBUG   ] Got command BAM from MCS: ref #330879
2018-10-31 10:33:44 [INFO    ] Finished processing BAM request
2018-10-31 10:33:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330879   8 58422 38024025 A  ERROR'
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:33:44 [DEBUG   ] spawn_process: at 2018-10-31 10:33:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:33:58 [DEBUG   ] Got command BAM from MCS: ref #330884
2018-10-31 10:33:58 [INFO    ] Finished processing BAM request
2018-10-31 10:33:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330884   8 58422 38038033 A  ERROR'
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:33:58 [DEBUG   ] spawn_process: at 2018-10-31 10:33:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:34:00 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-10-31 10:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:34:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:34:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:34:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:34:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:34:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:34:01 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-31 10:34:12 [DEBUG   ] Got command BAM from MCS: ref #330885
2018-10-31 10:34:12 [INFO    ] Finished processing BAM request
2018-10-31 10:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330885   8 58422 38052025 A  ERROR'
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:34:12 [DEBUG   ] spawn_process: at 2018-10-31 10:34:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:34:20 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-31 10:34:26 [DEBUG   ] Got command BAM from MCS: ref #330886
2018-10-31 10:34:26 [INFO    ] Finished processing BAM request
2018-10-31 10:34:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:34:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330886   8 58422 38066029 A  ERROR'
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:34:26 [DEBUG   ] spawn_process: at 2018-10-31 10:34:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:34:40 [DEBUG   ] Got command BAM from MCS: ref #330887
2018-10-31 10:34:40 [INFO    ] Finished processing BAM request
2018-10-31 10:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330887   8 58422 38080033 A  ERROR'
2018-10-31 10:34:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:34:40 [DEBUG   ] spawn_process: at 2018-10-31 10:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:34:54 [DEBUG   ] Got command BAM from MCS: ref #330888
2018-10-31 10:34:54 [INFO    ] Finished processing BAM request
2018-10-31 10:34:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330888   8 58422 38094029 A  ERROR'
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:34:54 [DEBUG   ] spawn_process: at 2018-10-31 10:34:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:35:00 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2018-10-31 10:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:35:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:35:01 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-31 10:35:08 [DEBUG   ] Got command BAM from MCS: ref #330889
2018-10-31 10:35:08 [INFO    ] Finished processing BAM request
2018-10-31 10:35:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330889   8 58422 38108025 A  ERROR'
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:35:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:35:08 [DEBUG   ] spawn_process: at 2018-10-31 10:35:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:35:20 [DEBUG   ] Finished updating ant stats in 0.371 seconds
2018-10-31 10:35:22 [DEBUG   ] Got command BAM from MCS: ref #330892
2018-10-31 10:35:22 [INFO    ] Finished processing BAM request
2018-10-31 10:35:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330892   8 58422 38122025 A  ERROR'
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:35:22 [DEBUG   ] spawn_process: at 2018-10-31 10:35:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:35:35 [DEBUG   ] Got command RPT from MCS: ref #330894
2018-10-31 10:35:35 [DEBUG   ] summary = ERROR
2018-10-31 10:35:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330894  13 58422 38135521 A  ERRORERROR'
2018-10-31 10:35:35 [DEBUG   ] Got command RPT from MCS: ref #330895
2018-10-31 10:35:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:35:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330895  77 58422 38135725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:35:35 [DEBUG   ] Got command RPT from MCS: ref #330896
2018-10-31 10:35:35 [DEBUG   ] summary = ERROR
2018-10-31 10:35:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330896  13 58422 38135917 A  ERRORERROR'
2018-10-31 10:35:36 [DEBUG   ] Got command BAM from MCS: ref #330893
2018-10-31 10:35:36 [INFO    ] Finished processing BAM request
2018-10-31 10:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330893   8 58422 38136029 A  ERROR'
2018-10-31 10:35:36 [DEBUG   ] Got command RPT from MCS: ref #330898
2018-10-31 10:35:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330898  77 58422 38136125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:35:36 [DEBUG   ] Got command RPT from MCS: ref #330899
2018-10-31 10:35:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330899  12 58422 38136317 A  ERRORB'
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:35:36 [DEBUG   ] spawn_process: at 2018-10-31 10:35:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:35:40 [DEBUG   ] Got command RPT from MCS: ref #330904
2018-10-31 10:35:40 [DEBUG   ] summary = ERROR
2018-10-31 10:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330904  13 58422 38140137 A  ERRORERROR'
2018-10-31 10:35:40 [DEBUG   ] Got command RPT from MCS: ref #330905
2018-10-31 10:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330905  77 58422 38140138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:35:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:35:50 [DEBUG   ] Got command BAM from MCS: ref #330921
2018-10-31 10:35:50 [INFO    ] Finished processing BAM request
2018-10-31 10:35:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:35:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330921   8 58422 38150033 A  ERROR'
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:35:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:35:50 [DEBUG   ] spawn_process: at 2018-10-31 10:35:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:36:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 10:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:36:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:36:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:36:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:36:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:36:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:36:02 [DEBUG   ] Finished updating board flags in 2.605 seconds
2018-10-31 10:36:04 [DEBUG   ] Got command BAM from MCS: ref #330922
2018-10-31 10:36:04 [INFO    ] Finished processing BAM request
2018-10-31 10:36:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:36:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330922   8 58422 38164029 A  ERROR'
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:36:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:36:04 [DEBUG   ] spawn_process: at 2018-10-31 10:36:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:36:18 [DEBUG   ] Got command BAM from MCS: ref #330923
2018-10-31 10:36:18 [INFO    ] Finished processing BAM request
2018-10-31 10:36:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330923   8 58422 38178033 A  ERROR'
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:36:18 [DEBUG   ] spawn_process: at 2018-10-31 10:36:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:36:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 10:36:32 [DEBUG   ] Got command BAM from MCS: ref #330924
2018-10-31 10:36:32 [INFO    ] Finished processing BAM request
2018-10-31 10:36:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330924   8 58422 38192025 A  ERROR'
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:36:32 [DEBUG   ] spawn_process: at 2018-10-31 10:36:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:36:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:36:46 [DEBUG   ] Got command BAM from MCS: ref #330925
2018-10-31 10:36:46 [INFO    ] Finished processing BAM request
2018-10-31 10:36:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330925   8 58422 38206033 A  ERROR'
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:36:46 [DEBUG   ] spawn_process: at 2018-10-31 10:36:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:37:00 [DEBUG   ] Got command BAM from MCS: ref #330930
2018-10-31 10:37:00 [INFO    ] Finished processing BAM request
2018-10-31 10:37:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330930   8 58422 38220037 A  ERROR'
2018-10-31 10:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:37:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:37:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:37:00 [DEBUG   ] Finished updating board flags in 1.081 seconds
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:37:00 [DEBUG   ] spawn_process: at 2018-10-31 10:37:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:37:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-31 10:37:14 [DEBUG   ] Got command BAM from MCS: ref #330931
2018-10-31 10:37:14 [INFO    ] Finished processing BAM request
2018-10-31 10:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330931   8 58422 38234029 A  ERROR'
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:37:14 [DEBUG   ] spawn_process: at 2018-10-31 10:37:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:37:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:37:28 [DEBUG   ] Got command BAM from MCS: ref #330932
2018-10-31 10:37:28 [INFO    ] Finished processing BAM request
2018-10-31 10:37:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330932   8 58422 38248025 A  ERROR'
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:37:28 [DEBUG   ] spawn_process: at 2018-10-31 10:37:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:37:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:37:42 [DEBUG   ] Got command BAM from MCS: ref #330933
2018-10-31 10:37:42 [INFO    ] Finished processing BAM request
2018-10-31 10:37:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330933   8 58422 38262033 A  ERROR'
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:37:42 [DEBUG   ] spawn_process: at 2018-10-31 10:37:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:37:56 [DEBUG   ] Got command BAM from MCS: ref #330934
2018-10-31 10:37:56 [INFO    ] Finished processing BAM request
2018-10-31 10:37:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:37:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330934   8 58422 38276029 A  ERROR'
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:37:56 [DEBUG   ] spawn_process: at 2018-10-31 10:37:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:38:00 [WARNING ] (13, 1, 'bot')
2018-10-31 10:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:38:00 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-10-31 10:38:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:38:10 [DEBUG   ] Got command BAM from MCS: ref #330935
2018-10-31 10:38:10 [INFO    ] Finished processing BAM request
2018-10-31 10:38:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330935   8 58422 38290033 A  ERROR'
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:38:10 [DEBUG   ] spawn_process: at 2018-10-31 10:38:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:38:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:38:24 [DEBUG   ] Got command BAM from MCS: ref #330936
2018-10-31 10:38:24 [INFO    ] Finished processing BAM request
2018-10-31 10:38:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330936   8 58422 38304029 A  ERROR'
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:38:24 [DEBUG   ] spawn_process: at 2018-10-31 10:38:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:38:38 [DEBUG   ] Got command BAM from MCS: ref #330937
2018-10-31 10:38:38 [INFO    ] Finished processing BAM request
2018-10-31 10:38:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330937   8 58422 38318029 A  ERROR'
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:38:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:38:38 [DEBUG   ] spawn_process: at 2018-10-31 10:38:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:38:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:38:53 [DEBUG   ] Got command BAM from MCS: ref #330938
2018-10-31 10:38:53 [INFO    ] Finished processing BAM request
2018-10-31 10:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330938   8 58422 38333025 A  ERROR'
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:38:53 [DEBUG   ] spawn_process: at 2018-10-31 10:38:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:39:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:39:01 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2018-10-31 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:39:01 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-31 10:39:08 [DEBUG   ] Got command BAM from MCS: ref #330939
2018-10-31 10:39:08 [INFO    ] Finished processing BAM request
2018-10-31 10:39:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330939   8 58422 38348025 A  ERROR'
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:39:08 [DEBUG   ] spawn_process: at 2018-10-31 10:39:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:39:21 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2018-10-31 10:39:23 [DEBUG   ] Got command BAM from MCS: ref #330940
2018-10-31 10:39:23 [INFO    ] Finished processing BAM request
2018-10-31 10:39:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330940   8 58422 38363033 A  ERROR'
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:39:23 [DEBUG   ] spawn_process: at 2018-10-31 10:39:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:39:38 [DEBUG   ] Got command BAM from MCS: ref #330941
2018-10-31 10:39:38 [INFO    ] Finished processing BAM request
2018-10-31 10:39:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330941   8 58422 38378025 A  ERROR'
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:39:38 [DEBUG   ] spawn_process: at 2018-10-31 10:39:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:39:41 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 10:39:53 [DEBUG   ] Got command BAM from MCS: ref #330942
2018-10-31 10:39:53 [INFO    ] Finished processing BAM request
2018-10-31 10:39:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330942   8 58422 38393033 A  ERROR'
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:39:53 [DEBUG   ] spawn_process: at 2018-10-31 10:39:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:40:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:40:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 10:40:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-31 10:40:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:40:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:40:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:40:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:40:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:40:02 [DEBUG   ] Finished updating board flags in 2.268 seconds
2018-10-31 10:40:08 [DEBUG   ] Got command BAM from MCS: ref #330947
2018-10-31 10:40:08 [INFO    ] Finished processing BAM request
2018-10-31 10:40:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330947   8 58422 38408029 A  ERROR'
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:40:08 [DEBUG   ] spawn_process: at 2018-10-31 10:40:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:40:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 10:40:23 [DEBUG   ] Got command BAM from MCS: ref #330948
2018-10-31 10:40:23 [INFO    ] Finished processing BAM request
2018-10-31 10:40:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330948   8 58422 38423029 A  ERROR'
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:40:23 [DEBUG   ] spawn_process: at 2018-10-31 10:40:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:40:35 [DEBUG   ] Got command RPT from MCS: ref #330949
2018-10-31 10:40:35 [DEBUG   ] summary = ERROR
2018-10-31 10:40:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330949  13 58422 38435605 A  ERRORERROR'
2018-10-31 10:40:35 [DEBUG   ] Got command RPT from MCS: ref #330950
2018-10-31 10:40:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:40:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330950  77 58422 38435809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:40:36 [DEBUG   ] Got command RPT from MCS: ref #330951
2018-10-31 10:40:36 [DEBUG   ] summary = ERROR
2018-10-31 10:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330951  13 58422 38436013 A  ERRORERROR'
2018-10-31 10:40:36 [DEBUG   ] Got command RPT from MCS: ref #330952
2018-10-31 10:40:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330952  77 58422 38436205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:40:36 [DEBUG   ] Got command RPT from MCS: ref #330953
2018-10-31 10:40:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330953  12 58422 38436409 A  ERRORB'
2018-10-31 10:40:38 [DEBUG   ] Got command BAM from MCS: ref #330954
2018-10-31 10:40:38 [INFO    ] Finished processing BAM request
2018-10-31 10:40:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:40:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330954   8 58422 38438033 A  ERROR'
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:40:38 [DEBUG   ] spawn_process: at 2018-10-31 10:40:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:40:40 [DEBUG   ] Got command RPT from MCS: ref #330955
2018-10-31 10:40:40 [DEBUG   ] summary = ERROR
2018-10-31 10:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330955  13 58422 38440137 A  ERRORERROR'
2018-10-31 10:40:40 [DEBUG   ] Got command RPT from MCS: ref #330956
2018-10-31 10:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330956  77 58422 38440138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:40:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 10:40:53 [DEBUG   ] Got command BAM from MCS: ref #330972
2018-10-31 10:40:53 [INFO    ] Finished processing BAM request
2018-10-31 10:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330972   8 58422 38453029 A  ERROR'
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:40:53 [DEBUG   ] spawn_process: at 2018-10-31 10:40:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:41:02 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-10-31 10:41:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:41:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:41:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:41:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:41:02 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-10-31 10:41:08 [DEBUG   ] Got command BAM from MCS: ref #330973
2018-10-31 10:41:08 [INFO    ] Finished processing BAM request
2018-10-31 10:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330973   8 58422 38468025 A  ERROR'
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:41:08 [DEBUG   ] spawn_process: at 2018-10-31 10:41:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:41:22 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-10-31 10:41:23 [DEBUG   ] Got command BAM from MCS: ref #330974
2018-10-31 10:41:23 [INFO    ] Finished processing BAM request
2018-10-31 10:41:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:41:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330974   8 58422 38483033 A  ERROR'
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:41:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:41:23 [DEBUG   ] spawn_process: at 2018-10-31 10:41:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:41:38 [DEBUG   ] Got command BAM from MCS: ref #330975
2018-10-31 10:41:38 [INFO    ] Finished processing BAM request
2018-10-31 10:41:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330975   8 58422 38498025 A  ERROR'
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:41:38 [DEBUG   ] spawn_process: at 2018-10-31 10:41:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:41:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:41:53 [DEBUG   ] Got command BAM from MCS: ref #330976
2018-10-31 10:41:53 [INFO    ] Finished processing BAM request
2018-10-31 10:41:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330976   8 58422 38513033 A  ERROR'
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:41:53 [DEBUG   ] spawn_process: at 2018-10-31 10:41:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:42:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:42:01 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-31 10:42:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:42:08 [DEBUG   ] Got command BAM from MCS: ref #330977
2018-10-31 10:42:08 [INFO    ] Finished processing BAM request
2018-10-31 10:42:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330977   8 58422 38528029 A  ERROR'
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:42:08 [DEBUG   ] spawn_process: at 2018-10-31 10:42:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:42:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 10:42:23 [DEBUG   ] Got command BAM from MCS: ref #330978
2018-10-31 10:42:23 [INFO    ] Finished processing BAM request
2018-10-31 10:42:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330978   8 58422 38543033 A  ERROR'
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:42:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:42:23 [DEBUG   ] spawn_process: at 2018-10-31 10:42:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:42:38 [DEBUG   ] Got command BAM from MCS: ref #330979
2018-10-31 10:42:38 [INFO    ] Finished processing BAM request
2018-10-31 10:42:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330979   8 58422 38558025 A  ERROR'
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:42:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:42:38 [DEBUG   ] spawn_process: at 2018-10-31 10:42:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:42:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:42:53 [DEBUG   ] Got command BAM from MCS: ref #330980
2018-10-31 10:42:53 [INFO    ] Finished processing BAM request
2018-10-31 10:42:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:42:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330980   8 58422 38573033 A  ERROR'
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:42:53 [DEBUG   ] spawn_process: at 2018-10-31 10:42:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:43:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:43:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:43:01 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-31 10:43:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 10:43:08 [DEBUG   ] Got command BAM from MCS: ref #330985
2018-10-31 10:43:08 [INFO    ] Finished processing BAM request
2018-10-31 10:43:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330985   8 58422 38588025 A  ERROR'
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:43:08 [DEBUG   ] spawn_process: at 2018-10-31 10:43:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:43:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:43:24 [DEBUG   ] Got command BAM from MCS: ref #330986
2018-10-31 10:43:24 [INFO    ] Finished processing BAM request
2018-10-31 10:43:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330986   8 58422 38604029 A  ERROR'
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:43:24 [DEBUG   ] spawn_process: at 2018-10-31 10:43:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:43:40 [DEBUG   ] Got command BAM from MCS: ref #330987
2018-10-31 10:43:40 [INFO    ] Finished processing BAM request
2018-10-31 10:43:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330987   8 58422 38620025 A  ERROR'
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:43:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:43:40 [DEBUG   ] spawn_process: at 2018-10-31 10:43:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:43:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 10:43:56 [DEBUG   ] Got command BAM from MCS: ref #330988
2018-10-31 10:43:56 [INFO    ] Finished processing BAM request
2018-10-31 10:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330988   8 58422 38636033 A  ERROR'
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:43:56 [DEBUG   ] spawn_process: at 2018-10-31 10:43:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:44:01 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-10-31 10:44:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:44:12 [DEBUG   ] Got command BAM from MCS: ref #330989
2018-10-31 10:44:12 [INFO    ] Finished processing BAM request
2018-10-31 10:44:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:44:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330989   8 58422 38652053 A  ERROR'
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:44:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:44:12 [DEBUG   ] spawn_process: at 2018-10-31 10:44:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:44:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 10:44:28 [DEBUG   ] Got command BAM from MCS: ref #330990
2018-10-31 10:44:28 [INFO    ] Finished processing BAM request
2018-10-31 10:44:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330990   8 58422 38668033 A  ERROR'
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:44:28 [DEBUG   ] spawn_process: at 2018-10-31 10:44:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:44:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 10:44:44 [DEBUG   ] Got command BAM from MCS: ref #330991
2018-10-31 10:44:44 [INFO    ] Finished processing BAM request
2018-10-31 10:44:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330991   8 58422 38684033 A  ERROR'
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:44:44 [DEBUG   ] spawn_process: at 2018-10-31 10:44:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:45:00 [DEBUG   ] Got command BAM from MCS: ref #330992
2018-10-31 10:45:00 [INFO    ] Finished processing BAM request
2018-10-31 10:45:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330992   8 58422 38700033 A  ERROR'
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:45:00 [DEBUG   ] spawn_process: at 2018-10-31 10:45:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:45:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:45:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:45:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:45:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:45:01 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-10-31 10:45:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 10:45:16 [DEBUG   ] Got command BAM from MCS: ref #330995
2018-10-31 10:45:16 [INFO    ] Finished processing BAM request
2018-10-31 10:45:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330995   8 58422 38716033 A  ERROR'
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:45:16 [DEBUG   ] spawn_process: at 2018-10-31 10:45:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:45:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:45:32 [DEBUG   ] Got command BAM from MCS: ref #330996
2018-10-31 10:45:32 [INFO    ] Finished processing BAM request
2018-10-31 10:45:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   330996   8 58422 38732029 A  ERROR'
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:45:32 [DEBUG   ] spawn_process: at 2018-10-31 10:45:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:45:35 [DEBUG   ] Got command RPT from MCS: ref #330997
2018-10-31 10:45:35 [DEBUG   ] summary = ERROR
2018-10-31 10:45:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330997  13 58422 38735694 A  ERRORERROR'
2018-10-31 10:45:35 [DEBUG   ] Got command RPT from MCS: ref #330998
2018-10-31 10:45:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:45:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330998  77 58422 38735897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:45:36 [DEBUG   ] Got command RPT from MCS: ref #330999
2018-10-31 10:45:36 [DEBUG   ] summary = ERROR
2018-10-31 10:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   330999  13 58422 38736089 A  ERRORERROR'
2018-10-31 10:45:36 [DEBUG   ] Got command RPT from MCS: ref #331001
2018-10-31 10:45:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331001  77 58422 38736293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:45:36 [DEBUG   ] Got command RPT from MCS: ref #331003
2018-10-31 10:45:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331003  12 58422 38736497 A  ERRORB'
2018-10-31 10:45:40 [DEBUG   ] Got command RPT from MCS: ref #331007
2018-10-31 10:45:40 [DEBUG   ] summary = ERROR
2018-10-31 10:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331007  13 58422 38740133 A  ERRORERROR'
2018-10-31 10:45:40 [DEBUG   ] Got command RPT from MCS: ref #331008
2018-10-31 10:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331008  77 58422 38740134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:45:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 10:45:48 [DEBUG   ] Got command BAM from MCS: ref #331024
2018-10-31 10:45:48 [INFO    ] Finished processing BAM request
2018-10-31 10:45:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331024   8 58422 38748033 A  ERROR'
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:45:48 [DEBUG   ] spawn_process: at 2018-10-31 10:45:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:46:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:46:02 [DEBUG   ] Finished updating ant stats in 0.626 seconds
2018-10-31 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:46:02 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-31 10:46:04 [DEBUG   ] Got command BAM from MCS: ref #331029
2018-10-31 10:46:04 [INFO    ] Finished processing BAM request
2018-10-31 10:46:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331029   8 58422 38764025 A  ERROR'
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:46:04 [DEBUG   ] spawn_process: at 2018-10-31 10:46:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:46:20 [DEBUG   ] Got command BAM from MCS: ref #331030
2018-10-31 10:46:20 [INFO    ] Finished processing BAM request
2018-10-31 10:46:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331030   8 58422 38780025 A  ERROR'
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:46:20 [DEBUG   ] spawn_process: at 2018-10-31 10:46:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:46:22 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-31 10:46:36 [DEBUG   ] Got command BAM from MCS: ref #331031
2018-10-31 10:46:36 [INFO    ] Finished processing BAM request
2018-10-31 10:46:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331031   8 58422 38796033 A  ERROR'
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:46:36 [DEBUG   ] spawn_process: at 2018-10-31 10:46:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:46:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 10:46:52 [DEBUG   ] Got command BAM from MCS: ref #331032
2018-10-31 10:46:52 [INFO    ] Finished processing BAM request
2018-10-31 10:46:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331032   8 58422 38812025 A  ERROR'
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:46:52 [DEBUG   ] spawn_process: at 2018-10-31 10:46:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:47:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:47:01 [WARNING ] (13, 1, 'bot')
2018-10-31 10:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:47:01 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-10-31 10:47:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:47:08 [DEBUG   ] Got command BAM from MCS: ref #331033
2018-10-31 10:47:08 [INFO    ] Finished processing BAM request
2018-10-31 10:47:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331033   8 58422 38828029 A  ERROR'
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:47:08 [DEBUG   ] spawn_process: at 2018-10-31 10:47:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:47:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 10:47:24 [DEBUG   ] Got command BAM from MCS: ref #331034
2018-10-31 10:47:24 [INFO    ] Finished processing BAM request
2018-10-31 10:47:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331034   8 58422 38844025 A  ERROR'
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:47:24 [DEBUG   ] spawn_process: at 2018-10-31 10:47:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:47:41 [DEBUG   ] Got command BAM from MCS: ref #331035
2018-10-31 10:47:41 [INFO    ] Finished processing BAM request
2018-10-31 10:47:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331035   8 58422 38861033 A  ERROR'
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:47:41 [DEBUG   ] spawn_process: at 2018-10-31 10:47:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:47:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:47:58 [DEBUG   ] Got command BAM from MCS: ref #331036
2018-10-31 10:47:58 [INFO    ] Finished processing BAM request
2018-10-31 10:47:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331036   8 58422 38878029 A  ERROR'
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:47:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:47:58 [DEBUG   ] spawn_process: at 2018-10-31 10:47:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:48:02 [DEBUG   ] Finished updating ant stats in 0.433 seconds
2018-10-31 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:48:02 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-31 10:48:15 [DEBUG   ] Got command BAM from MCS: ref #331037
2018-10-31 10:48:15 [INFO    ] Finished processing BAM request
2018-10-31 10:48:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331037   8 58422 38895033 A  ERROR'
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:48:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:48:15 [DEBUG   ] spawn_process: at 2018-10-31 10:48:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:48:22 [DEBUG   ] Finished updating ant stats in 0.371 seconds
2018-10-31 10:48:32 [DEBUG   ] Got command BAM from MCS: ref #331038
2018-10-31 10:48:32 [INFO    ] Finished processing BAM request
2018-10-31 10:48:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331038   8 58422 38912030 A  ERROR'
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:48:32 [DEBUG   ] spawn_process: at 2018-10-31 10:48:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:48:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:48:49 [DEBUG   ] Got command BAM from MCS: ref #331039
2018-10-31 10:48:49 [INFO    ] Finished processing BAM request
2018-10-31 10:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331039   8 58422 38929029 A  ERROR'
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:48:49 [DEBUG   ] spawn_process: at 2018-10-31 10:48:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:49:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:49:02 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-10-31 10:49:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:49:06 [DEBUG   ] Got command BAM from MCS: ref #331044
2018-10-31 10:49:06 [INFO    ] Finished processing BAM request
2018-10-31 10:49:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331044   8 58422 38946033 A  ERROR'
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:49:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:49:06 [DEBUG   ] spawn_process: at 2018-10-31 10:49:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:49:23 [DEBUG   ] Got command BAM from MCS: ref #331045
2018-10-31 10:49:23 [INFO    ] Finished processing BAM request
2018-10-31 10:49:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:49:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331045   8 58422 38963030 A  ERROR'
2018-10-31 10:49:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:49:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:49:23 [DEBUG   ] spawn_process: at 2018-10-31 10:49:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:49:40 [DEBUG   ] Got command BAM from MCS: ref #331046
2018-10-31 10:49:40 [INFO    ] Finished processing BAM request
2018-10-31 10:49:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:49:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331046   8 58422 38980026 A  ERROR'
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:49:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:49:40 [DEBUG   ] spawn_process: at 2018-10-31 10:49:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:49:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:49:57 [DEBUG   ] Got command BAM from MCS: ref #331047
2018-10-31 10:49:57 [INFO    ] Finished processing BAM request
2018-10-31 10:49:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331047   8 58422 38997038 A  ERROR'
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:49:57 [DEBUG   ] spawn_process: at 2018-10-31 10:49:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-31 10:50:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:50:02 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-10-31 10:50:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:50:14 [DEBUG   ] Got command BAM from MCS: ref #331048
2018-10-31 10:50:14 [INFO    ] Finished processing BAM request
2018-10-31 10:50:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331048   8 58422 39014026 A  ERROR'
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:50:14 [DEBUG   ] spawn_process: at 2018-10-31 10:50:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:50:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:50:31 [DEBUG   ] Got command BAM from MCS: ref #331049
2018-10-31 10:50:31 [INFO    ] Finished processing BAM request
2018-10-31 10:50:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331049   8 58422 39031033 A  ERROR'
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:50:31 [DEBUG   ] spawn_process: at 2018-10-31 10:50:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:50:35 [DEBUG   ] Got command RPT from MCS: ref #331050
2018-10-31 10:50:35 [DEBUG   ] summary = ERROR
2018-10-31 10:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331050  13 58422 39035773 A  ERRORERROR'
2018-10-31 10:50:35 [DEBUG   ] Got command RPT from MCS: ref #331051
2018-10-31 10:50:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331051  77 58422 39035977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:50:36 [DEBUG   ] Got command RPT from MCS: ref #331052
2018-10-31 10:50:36 [DEBUG   ] summary = ERROR
2018-10-31 10:50:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331052  13 58422 39036181 A  ERRORERROR'
2018-10-31 10:50:36 [DEBUG   ] Got command RPT from MCS: ref #331053
2018-10-31 10:50:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:50:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331053  77 58422 39036385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:50:36 [DEBUG   ] Got command RPT from MCS: ref #331054
2018-10-31 10:50:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:50:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331054  12 58422 39036577 A  ERRORB'
2018-10-31 10:50:40 [DEBUG   ] Got command RPT from MCS: ref #331055
2018-10-31 10:50:40 [DEBUG   ] summary = ERROR
2018-10-31 10:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331055  13 58422 39040141 A  ERRORERROR'
2018-10-31 10:50:40 [DEBUG   ] Got command RPT from MCS: ref #331056
2018-10-31 10:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331056  77 58422 39040142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:50:43 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 10:50:48 [DEBUG   ] Got command BAM from MCS: ref #331072
2018-10-31 10:50:48 [INFO    ] Finished processing BAM request
2018-10-31 10:50:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331072   8 58422 39048033 A  ERROR'
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:50:48 [DEBUG   ] spawn_process: at 2018-10-31 10:50:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:51:03 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-10-31 10:51:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:51:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:51:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:51:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:51:03 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-10-31 10:51:05 [DEBUG   ] Got command BAM from MCS: ref #331073
2018-10-31 10:51:05 [INFO    ] Finished processing BAM request
2018-10-31 10:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331073   8 58422 39065025 A  ERROR'
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:51:05 [DEBUG   ] spawn_process: at 2018-10-31 10:51:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:51:23 [DEBUG   ] Got command BAM from MCS: ref #331074
2018-10-31 10:51:23 [INFO    ] Finished processing BAM request
2018-10-31 10:51:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331074   8 58422 39083029 A  ERROR'
2018-10-31 10:51:23 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:51:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:51:23 [DEBUG   ] spawn_process: at 2018-10-31 10:51:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:51:41 [DEBUG   ] Got command BAM from MCS: ref #331075
2018-10-31 10:51:41 [INFO    ] Finished processing BAM request
2018-10-31 10:51:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331075   8 58422 39101033 A  ERROR'
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:51:41 [DEBUG   ] spawn_process: at 2018-10-31 10:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:51:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 10:51:59 [DEBUG   ] Got command BAM from MCS: ref #331080
2018-10-31 10:51:59 [INFO    ] Finished processing BAM request
2018-10-31 10:51:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331080   8 58422 39119029 A  ERROR'
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:51:59 [DEBUG   ] spawn_process: at 2018-10-31 10:51:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:52:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 10:52:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:52:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:52:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:52:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:52:03 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-31 10:52:17 [DEBUG   ] Got command BAM from MCS: ref #331081
2018-10-31 10:52:17 [INFO    ] Finished processing BAM request
2018-10-31 10:52:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331081   8 58422 39137033 A  ERROR'
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:52:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:52:17 [DEBUG   ] spawn_process: at 2018-10-31 10:52:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:52:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-31 10:52:35 [DEBUG   ] Got command BAM from MCS: ref #331082
2018-10-31 10:52:35 [INFO    ] Finished processing BAM request
2018-10-31 10:52:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331082   8 58422 39155026 A  ERROR'
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:52:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:52:35 [DEBUG   ] spawn_process: at 2018-10-31 10:52:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:52:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 10:52:53 [DEBUG   ] Got command BAM from MCS: ref #331083
2018-10-31 10:52:53 [INFO    ] Finished processing BAM request
2018-10-31 10:52:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:52:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331083   8 58422 39173030 A  ERROR'
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:52:53 [DEBUG   ] spawn_process: at 2018-10-31 10:52:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:53:03 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-10-31 10:53:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:53:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:53:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:53:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:53:03 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-10-31 10:53:11 [DEBUG   ] Got command BAM from MCS: ref #331084
2018-10-31 10:53:11 [INFO    ] Finished processing BAM request
2018-10-31 10:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331084   8 58422 39191034 A  ERROR'
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:53:11 [DEBUG   ] spawn_process: at 2018-10-31 10:53:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:53:23 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2018-10-31 10:53:29 [DEBUG   ] Got command BAM from MCS: ref #331085
2018-10-31 10:53:29 [INFO    ] Finished processing BAM request
2018-10-31 10:53:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331085   8 58422 39209025 A  ERROR'
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:53:29 [DEBUG   ] spawn_process: at 2018-10-31 10:53:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:53:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:53:47 [DEBUG   ] Got command BAM from MCS: ref #331086
2018-10-31 10:53:47 [INFO    ] Finished processing BAM request
2018-10-31 10:53:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:53:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331086   8 58422 39227029 A  ERROR'
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:53:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:53:47 [DEBUG   ] spawn_process: at 2018-10-31 10:53:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:54:02 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-10-31 10:54:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:54:05 [DEBUG   ] Got command BAM from MCS: ref #331087
2018-10-31 10:54:05 [INFO    ] Finished processing BAM request
2018-10-31 10:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331087   8 58422 39245029 A  ERROR'
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:54:05 [DEBUG   ] spawn_process: at 2018-10-31 10:54:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:54:23 [DEBUG   ] Got command BAM from MCS: ref #331088
2018-10-31 10:54:23 [INFO    ] Finished processing BAM request
2018-10-31 10:54:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331088   8 58422 39263025 A  ERROR'
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:54:23 [DEBUG   ] spawn_process: at 2018-10-31 10:54:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:54:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:54:41 [DEBUG   ] Got command BAM from MCS: ref #331089
2018-10-31 10:54:41 [INFO    ] Finished processing BAM request
2018-10-31 10:54:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:54:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331089   8 58422 39281029 A  ERROR'
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:54:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:54:41 [DEBUG   ] spawn_process: at 2018-10-31 10:54:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:54:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:55:00 [DEBUG   ] Got command BAM from MCS: ref #331094
2018-10-31 10:55:00 [INFO    ] Finished processing BAM request
2018-10-31 10:55:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331094   8 58422 39300029 A  ERROR'
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:55:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:55:00 [DEBUG   ] spawn_process: at 2018-10-31 10:55:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-31 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-31 10:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:55:02 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-31 10:55:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:55:19 [DEBUG   ] Got command BAM from MCS: ref #331097
2018-10-31 10:55:19 [INFO    ] Finished processing BAM request
2018-10-31 10:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331097   8 58422 39319029 A  ERROR'
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-31 10:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-31 10:55:19 [DEBUG   ] spawn_process: at 2018-10-31 10:55:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-31 10:55:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:55:35 [DEBUG   ] Got command RPT from MCS: ref #331098
2018-10-31 10:55:35 [DEBUG   ] summary = ERROR
2018-10-31 10:55:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331098  13 58422 39335857 A  ERRORERROR'
2018-10-31 10:55:36 [DEBUG   ] Got command RPT from MCS: ref #331099
2018-10-31 10:55:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331099  77 58422 39336061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:55:36 [DEBUG   ] Got command RPT from MCS: ref #331100
2018-10-31 10:55:36 [DEBUG   ] summary = ERROR
2018-10-31 10:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331100  13 58422 39336265 A  ERRORERROR'
2018-10-31 10:55:36 [DEBUG   ] Got command RPT from MCS: ref #331102
2018-10-31 10:55:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331102  77 58422 39336469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:55:36 [DEBUG   ] Got command RPT from MCS: ref #331104
2018-10-31 10:55:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 10:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331104  12 58422 39336661 A  ERRORB'
2018-10-31 10:55:38 [DEBUG   ] Got command BAM from MCS: ref #331106
2018-10-31 10:55:38 [INFO    ] Finished processing BAM request
2018-10-31 10:55:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:55:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331106   8 58422 39338033 A  ERROR'
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-31 10:55:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-31 10:55:38 [DEBUG   ] spawn_process: at 2018-10-31 10:55:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-31 10:55:40 [DEBUG   ] Got command RPT from MCS: ref #331109
2018-10-31 10:55:40 [DEBUG   ] summary = ERROR
2018-10-31 10:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331109  13 58422 39340133 A  ERRORERROR'
2018-10-31 10:55:40 [DEBUG   ] Got command RPT from MCS: ref #331110
2018-10-31 10:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 10:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331110  77 58422 39340134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 10:55:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:55:57 [DEBUG   ] Got command BAM from MCS: ref #331126
2018-10-31 10:55:57 [INFO    ] Finished processing BAM request
2018-10-31 10:55:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331126   8 58422 39357033 A  ERROR'
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:55:57 [DEBUG   ] spawn_process: at 2018-10-31 10:55:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:56:03 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-31 10:56:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:56:16 [DEBUG   ] Got command BAM from MCS: ref #331127
2018-10-31 10:56:16 [INFO    ] Finished processing BAM request
2018-10-31 10:56:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331127   8 58422 39376025 A  ERROR'
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:56:16 [DEBUG   ] spawn_process: at 2018-10-31 10:56:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 10:56:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:56:35 [DEBUG   ] Got command BAM from MCS: ref #331128
2018-10-31 10:56:35 [INFO    ] Finished processing BAM request
2018-10-31 10:56:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331128   8 58422 39395029 A  ERROR'
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:56:35 [DEBUG   ] spawn_process: at 2018-10-31 10:56:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:56:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:56:54 [DEBUG   ] Got command BAM from MCS: ref #331129
2018-10-31 10:56:54 [INFO    ] Finished processing BAM request
2018-10-31 10:56:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331129   8 58422 39414033 A  ERROR'
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:56:54 [DEBUG   ] spawn_process: at 2018-10-31 10:56:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:57:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:57:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:57:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-31 10:57:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 10:57:13 [DEBUG   ] Got command BAM from MCS: ref #331130
2018-10-31 10:57:13 [INFO    ] Finished processing BAM request
2018-10-31 10:57:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331130   8 58422 39433025 A  ERROR'
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:57:13 [DEBUG   ] spawn_process: at 2018-10-31 10:57:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:57:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:57:32 [DEBUG   ] Got command BAM from MCS: ref #331131
2018-10-31 10:57:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331131   8 58422 39452025 A  ERROR'
2018-10-31 10:57:32 [INFO    ] Finished processing BAM request
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:57:32 [DEBUG   ] spawn_process: at 2018-10-31 10:57:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:57:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:57:51 [DEBUG   ] Got command BAM from MCS: ref #331132
2018-10-31 10:57:51 [INFO    ] Finished processing BAM request
2018-10-31 10:57:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:57:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331132   8 58422 39471033 A  ERROR'
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:57:51 [DEBUG   ] spawn_process: at 2018-10-31 10:57:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:58:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 10:58:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:58:03 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-31 10:58:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:58:11 [DEBUG   ] Got command BAM from MCS: ref #331137
2018-10-31 10:58:11 [INFO    ] Finished processing BAM request
2018-10-31 10:58:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331137   8 58422 39491033 A  ERROR'
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-31 10:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-31 10:58:11 [DEBUG   ] spawn_process: at 2018-10-31 10:58:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-31 10:58:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 10:58:31 [DEBUG   ] Got command BAM from MCS: ref #331138
2018-10-31 10:58:31 [INFO    ] Finished processing BAM request
2018-10-31 10:58:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331138   8 58422 39511030 A  ERROR'
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:58:31 [DEBUG   ] spawn_process: at 2018-10-31 10:58:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:58:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:58:51 [DEBUG   ] Got command BAM from MCS: ref #331139
2018-10-31 10:58:51 [INFO    ] Finished processing BAM request
2018-10-31 10:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331139   8 58422 39531026 A  ERROR'
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:58:51 [DEBUG   ] spawn_process: at 2018-10-31 10:58:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:59:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-31 10:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 10:59:03 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-10-31 10:59:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 10:59:11 [DEBUG   ] Got command BAM from MCS: ref #331140
2018-10-31 10:59:11 [INFO    ] Finished processing BAM request
2018-10-31 10:59:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:59:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331140   8 58422 39551033 A  ERROR'
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:59:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:59:11 [DEBUG   ] spawn_process: at 2018-10-31 10:59:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:59:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 10:59:31 [DEBUG   ] Got command BAM from MCS: ref #331141
2018-10-31 10:59:31 [INFO    ] Finished processing BAM request
2018-10-31 10:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331141   8 58422 39571025 A  ERROR'
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-31 10:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-31 10:59:31 [DEBUG   ] spawn_process: at 2018-10-31 10:59:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-31 10:59:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 10:59:51 [DEBUG   ] Got command BAM from MCS: ref #331142
2018-10-31 10:59:51 [INFO    ] Finished processing BAM request
2018-10-31 10:59:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-31 10:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   331142   8 58422 39591025 A  ERROR'
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 10:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 10:59:51 [DEBUG   ] spawn_process: at 2018-10-31 10:59:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 11:00:00 [DEBUG   ] Got command STP from MCS: ref #331143
2018-10-31 11:00:00 [INFO    ] Finished processing BAM request
2018-10-31 11:00:00 [INFO    ] Shutdown the adder chain on beam #4
2018-10-31 11:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   331143   8 58422 39600029 A  ERROR'
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-31 11:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-31 11:00:00 [DEBUG   ] spawn_process: at 2018-10-31 11:00:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-31 11:00:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:00:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 11:00:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:00:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:00:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:00:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:00:04 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-10-31 11:00:24 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-31 11:00:35 [DEBUG   ] Got command RPT from MCS: ref #331144
2018-10-31 11:00:35 [DEBUG   ] summary = ERROR
2018-10-31 11:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331144  13 58422 39635949 A  ERRORERROR'
2018-10-31 11:00:36 [DEBUG   ] Got command RPT from MCS: ref #331145
2018-10-31 11:00:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331145  77 58422 39636153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:00:36 [DEBUG   ] Got command RPT from MCS: ref #331146
2018-10-31 11:00:36 [DEBUG   ] summary = ERROR
2018-10-31 11:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331146  13 58422 39636345 A  ERRORERROR'
2018-10-31 11:00:36 [DEBUG   ] Got command RPT from MCS: ref #331147
2018-10-31 11:00:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331147  77 58422 39636549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:00:36 [DEBUG   ] Got command RPT from MCS: ref #331148
2018-10-31 11:00:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331148  12 58422 39636753 A  ERRORB'
2018-10-31 11:00:40 [DEBUG   ] Got command RPT from MCS: ref #331149
2018-10-31 11:00:40 [DEBUG   ] summary = ERROR
2018-10-31 11:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331149  13 58422 39640137 A  ERRORERROR'
2018-10-31 11:00:40 [DEBUG   ] Got command RPT from MCS: ref #331150
2018-10-31 11:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331150  77 58422 39640138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:00:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:01:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:01:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:01:03 [DEBUG   ] Finished updating board flags in 1.106 seconds
2018-10-31 11:01:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-31 11:01:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 11:01:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 11:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:02:03 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-10-31 11:02:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 11:02:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:02:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:03:04 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-10-31 11:03:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:03:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:03:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:03:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:03:04 [DEBUG   ] Finished updating board flags in 1.875 seconds
2018-10-31 11:03:24 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-31 11:03:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-31 11:04:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:04:03 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-31 11:04:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:04:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 11:04:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:05:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:05:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:05:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:05:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:05:04 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-31 11:05:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 11:05:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:05:36 [DEBUG   ] Got command RPT from MCS: ref #331176
2018-10-31 11:05:36 [DEBUG   ] summary = ERROR
2018-10-31 11:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331176  13 58422 39936037 A  ERRORERROR'
2018-10-31 11:05:36 [DEBUG   ] Got command RPT from MCS: ref #331177
2018-10-31 11:05:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331177  77 58422 39936241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:05:36 [DEBUG   ] Got command RPT from MCS: ref #331178
2018-10-31 11:05:36 [DEBUG   ] summary = ERROR
2018-10-31 11:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331178  13 58422 39936433 A  ERRORERROR'
2018-10-31 11:05:36 [DEBUG   ] Got command RPT from MCS: ref #331180
2018-10-31 11:05:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331180  77 58422 39936637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:05:36 [DEBUG   ] Got command RPT from MCS: ref #331181
2018-10-31 11:05:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331181  12 58422 39936841 A  ERRORB'
2018-10-31 11:05:40 [DEBUG   ] Got command RPT from MCS: ref #331186
2018-10-31 11:05:40 [DEBUG   ] summary = ERROR
2018-10-31 11:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331186  13 58422 39940141 A  ERRORERROR'
2018-10-31 11:05:40 [DEBUG   ] Got command RPT from MCS: ref #331187
2018-10-31 11:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331187  77 58422 39940142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:05:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:06:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:06:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:06:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:06:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:06:04 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-31 11:06:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:06:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:06:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:07:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:07:04 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-31 11:07:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:07:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:07:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:08:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:08:04 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-31 11:08:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:08:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:08:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:09:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:09:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:09:04 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-10-31 11:09:05 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-31 11:09:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:09:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:10:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:10:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:10:04 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-10-31 11:10:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:10:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 11:10:36 [DEBUG   ] Got command RPT from MCS: ref #331211
2018-10-31 11:10:36 [DEBUG   ] summary = ERROR
2018-10-31 11:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331211  13 58422 40236117 A  ERRORERROR'
2018-10-31 11:10:36 [DEBUG   ] Got command RPT from MCS: ref #331212
2018-10-31 11:10:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331212  77 58422 40236332 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:10:36 [DEBUG   ] Got command RPT from MCS: ref #331213
2018-10-31 11:10:36 [DEBUG   ] summary = ERROR
2018-10-31 11:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331213  13 58422 40236521 A  ERRORERROR'
2018-10-31 11:10:36 [DEBUG   ] Got command RPT from MCS: ref #331214
2018-10-31 11:10:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331214  77 58422 40236725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:10:36 [DEBUG   ] Got command RPT from MCS: ref #331215
2018-10-31 11:10:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331215  12 58422 40236929 A  ERRORB'
2018-10-31 11:10:40 [DEBUG   ] Got command RPT from MCS: ref #331216
2018-10-31 11:10:40 [DEBUG   ] summary = ERROR
2018-10-31 11:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331216  13 58422 40240133 A  ERRORERROR'
2018-10-31 11:10:40 [DEBUG   ] Got command RPT from MCS: ref #331217
2018-10-31 11:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331217  77 58422 40240134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:10:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 11:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:11:04 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-10-31 11:11:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 11:11:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 11:11:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 11:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:12:05 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2018-10-31 11:12:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:12:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:12:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:12:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:12:05 [DEBUG   ] Finished updating board flags in 1.892 seconds
2018-10-31 11:12:25 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-31 11:12:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:13:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:13:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:13:04 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-31 11:13:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:13:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:13:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:14:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:14:04 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-10-31 11:14:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:14:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:14:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 11:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:15:05 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-10-31 11:15:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:15:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:15:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:15:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:15:05 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-31 11:15:25 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-31 11:15:36 [DEBUG   ] Got command RPT from MCS: ref #331239
2018-10-31 11:15:36 [DEBUG   ] summary = ERROR
2018-10-31 11:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331239  13 58422 40536209 A  ERRORERROR'
2018-10-31 11:15:36 [DEBUG   ] Got command RPT from MCS: ref #331240
2018-10-31 11:15:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331240  77 58422 40536413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:15:36 [DEBUG   ] Got command RPT from MCS: ref #331241
2018-10-31 11:15:36 [DEBUG   ] summary = ERROR
2018-10-31 11:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331241  13 58422 40536605 A  ERRORERROR'
2018-10-31 11:15:36 [DEBUG   ] Got command RPT from MCS: ref #331243
2018-10-31 11:15:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331243  77 58422 40536809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:15:37 [DEBUG   ] Got command RPT from MCS: ref #331245
2018-10-31 11:15:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331245  12 58422 40537013 A  ERRORB'
2018-10-31 11:15:40 [DEBUG   ] Got command RPT from MCS: ref #331249
2018-10-31 11:15:40 [DEBUG   ] summary = ERROR
2018-10-31 11:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331249  13 58422 40540145 A  ERRORERROR'
2018-10-31 11:15:40 [DEBUG   ] Got command RPT from MCS: ref #331250
2018-10-31 11:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331250  77 58422 40540146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:15:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:16:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-31 11:16:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:16:04 [DEBUG   ] Finished updating board flags in 0.967 seconds
2018-10-31 11:16:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:16:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 11:16:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:17:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:17:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:17:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:17:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:17:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:17:05 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-10-31 11:17:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:17:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:17:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:18:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:18:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:18:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 11:18:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:18:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:18:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:18:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:18:06 [DEBUG   ] Finished updating board flags in 2.099 seconds
2018-10-31 11:18:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 11:18:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:19:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:19:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:19:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:19:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:19:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:19:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:19:05 [DEBUG   ] Finished updating board flags in 1.107 seconds
2018-10-31 11:19:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-31 11:19:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 11:19:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 11:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:20:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-31 11:20:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:20:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:20:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:20:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:20:06 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-10-31 11:20:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-31 11:20:36 [DEBUG   ] Got command RPT from MCS: ref #331274
2018-10-31 11:20:36 [DEBUG   ] summary = ERROR
2018-10-31 11:20:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331274  13 58422 40836297 A  ERRORERROR'
2018-10-31 11:20:36 [DEBUG   ] Got command RPT from MCS: ref #331275
2018-10-31 11:20:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:20:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331275  77 58422 40836501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:20:36 [DEBUG   ] Got command RPT from MCS: ref #331276
2018-10-31 11:20:36 [DEBUG   ] summary = ERROR
2018-10-31 11:20:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331276  13 58422 40836693 A  ERRORERROR'
2018-10-31 11:20:36 [DEBUG   ] Got command RPT from MCS: ref #331277
2018-10-31 11:20:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:20:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331277  77 58422 40836897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:20:37 [DEBUG   ] Got command RPT from MCS: ref #331278
2018-10-31 11:20:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331278  12 58422 40837101 A  ERRORB'
2018-10-31 11:20:40 [DEBUG   ] Got command RPT from MCS: ref #331279
2018-10-31 11:20:40 [DEBUG   ] summary = ERROR
2018-10-31 11:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331279  13 58422 40840137 A  ERRORERROR'
2018-10-31 11:20:40 [DEBUG   ] Got command RPT from MCS: ref #331280
2018-10-31 11:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331280  77 58422 40840138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:20:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:21:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-31 11:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:21:05 [DEBUG   ] Finished updating board flags in 1.300 seconds
2018-10-31 11:21:06 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 11:21:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:21:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:22:00 [DEBUG   ] Got command TBN from MCS: ref #331300
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-31 11:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   331300   8 58422 40920402 A  ERROR'
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540984921']
2018-10-31 11:22:00 [DEBUG   ] spawn_process: at 2018-10-31 11:22:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540984921']
2018-10-31 11:22:00 [INFO    ] Finished spawning TBN in 0.047 s
2018-10-31 11:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:22:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:22:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:22:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:22:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:22:06 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-10-31 11:22:07 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2018-10-31 11:22:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 11:22:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-31 11:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:23:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:23:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:23:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:23:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:23:06 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-31 11:23:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:23:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:23:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:24:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:24:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:24:08 [DEBUG   ] Finished updating board flags in 3.597 seconds
2018-10-31 11:24:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:24:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:25:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:25:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:25:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:25:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:25:06 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-31 11:25:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:25:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:25:36 [DEBUG   ] Got command RPT from MCS: ref #331307
2018-10-31 11:25:36 [DEBUG   ] summary = ERROR
2018-10-31 11:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331307  13 58422 41136381 A  ERRORERROR'
2018-10-31 11:25:36 [DEBUG   ] Got command RPT from MCS: ref #331308
2018-10-31 11:25:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331308  77 58422 41136585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:25:36 [DEBUG   ] Got command RPT from MCS: ref #331309
2018-10-31 11:25:36 [DEBUG   ] summary = ERROR
2018-10-31 11:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331309  13 58422 41136777 A  ERRORERROR'
2018-10-31 11:25:36 [DEBUG   ] Got command RPT from MCS: ref #331311
2018-10-31 11:25:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331311  77 58422 41136981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:25:37 [DEBUG   ] Got command RPT from MCS: ref #331312
2018-10-31 11:25:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331312  12 58422 41137185 A  ERRORB'
2018-10-31 11:25:40 [DEBUG   ] Got command RPT from MCS: ref #331317
2018-10-31 11:25:40 [DEBUG   ] summary = ERROR
2018-10-31 11:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331317  13 58422 41140149 A  ERRORERROR'
2018-10-31 11:25:40 [DEBUG   ] Got command RPT from MCS: ref #331318
2018-10-31 11:25:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331318  77 58422 41140150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:25:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:26:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:26:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:26:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:26:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:26:06 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-31 11:26:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:26:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:26:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:27:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:27:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:27:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:27:06 [WARNING ] (13, 1, 'bot')
2018-10-31 11:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:27:06 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-10-31 11:27:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:27:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:27:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 11:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:28:07 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-10-31 11:28:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:28:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:28:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:28:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:28:07 [DEBUG   ] Finished updating board flags in 2.180 seconds
2018-10-31 11:28:27 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-10-31 11:28:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 11:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:29:07 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-10-31 11:29:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:29:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:29:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:29:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:29:07 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-31 11:29:27 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-10-31 11:29:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 11:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:30:07 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-10-31 11:30:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:30:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:30:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:30:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:30:07 [DEBUG   ] Finished updating board flags in 1.968 seconds
2018-10-31 11:30:27 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-31 11:30:36 [DEBUG   ] Got command RPT from MCS: ref #331338
2018-10-31 11:30:36 [DEBUG   ] summary = ERROR
2018-10-31 11:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331338  13 58422 41436461 A  ERRORERROR'
2018-10-31 11:30:36 [DEBUG   ] Got command RPT from MCS: ref #331339
2018-10-31 11:30:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331339  77 58422 41436665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:30:36 [DEBUG   ] Got command RPT from MCS: ref #331340
2018-10-31 11:30:36 [DEBUG   ] summary = ERROR
2018-10-31 11:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331340  13 58422 41436869 A  ERRORERROR'
2018-10-31 11:30:37 [DEBUG   ] Got command RPT from MCS: ref #331341
2018-10-31 11:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331341  77 58422 41437073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:30:37 [DEBUG   ] Got command RPT from MCS: ref #331342
2018-10-31 11:30:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331342  12 58422 41437269 A  ERRORB'
2018-10-31 11:30:40 [DEBUG   ] Got command RPT from MCS: ref #331343
2018-10-31 11:30:40 [DEBUG   ] summary = ERROR
2018-10-31 11:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331343  13 58422 41440145 A  ERRORERROR'
2018-10-31 11:30:40 [DEBUG   ] Got command RPT from MCS: ref #331344
2018-10-31 11:30:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331344  77 58422 41440146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:30:47 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-31 11:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:31:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:31:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:31:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:31:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:31:07 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-31 11:31:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 11:31:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 11:31:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:32:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:32:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:32:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:32:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:32:07 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-31 11:32:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:32:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 11:32:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 11:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:33:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:33:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:33:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:33:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:33:07 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-10-31 11:33:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 11:33:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:33:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:34:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:34:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:34:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:34:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:34:07 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-31 11:34:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:34:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:34:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:35:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:35:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:35:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:35:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:35:07 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-10-31 11:35:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:35:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 11:35:36 [DEBUG   ] Got command RPT from MCS: ref #331370
2018-10-31 11:35:36 [DEBUG   ] summary = ERROR
2018-10-31 11:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331370  13 58422 41736549 A  ERRORERROR'
2018-10-31 11:35:36 [DEBUG   ] Got command RPT from MCS: ref #331371
2018-10-31 11:35:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331371  77 58422 41736753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:35:36 [DEBUG   ] Got command RPT from MCS: ref #331372
2018-10-31 11:35:36 [DEBUG   ] summary = ERROR
2018-10-31 11:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331372  13 58422 41736957 A  ERRORERROR'
2018-10-31 11:35:37 [DEBUG   ] Got command RPT from MCS: ref #331374
2018-10-31 11:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331374  77 58422 41737161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:35:37 [DEBUG   ] Got command RPT from MCS: ref #331375
2018-10-31 11:35:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331375  12 58422 41737353 A  ERRORB'
2018-10-31 11:35:40 [DEBUG   ] Got command RPT from MCS: ref #331380
2018-10-31 11:35:40 [DEBUG   ] summary = ERROR
2018-10-31 11:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331380  13 58422 41740149 A  ERRORERROR'
2018-10-31 11:35:40 [DEBUG   ] Got command RPT from MCS: ref #331381
2018-10-31 11:35:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331381  77 58422 41740150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:35:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 11:36:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:36:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:36:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:36:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:36:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:36:07 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-10-31 11:36:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 11:36:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:36:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:37:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:37:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:37:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:37:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:37:07 [WARNING ] (13, 1, 'bot')
2018-10-31 11:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:37:07 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-10-31 11:37:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:37:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:37:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:38:08 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-10-31 11:38:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:38:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:38:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:38:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:38:08 [DEBUG   ] Finished updating board flags in 2.147 seconds
2018-10-31 11:38:28 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-10-31 11:38:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 11:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:39:08 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-10-31 11:39:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:39:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:39:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:39:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:39:08 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-31 11:39:28 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-31 11:39:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-31 11:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:40:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:40:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:40:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:40:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:40:08 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-31 11:40:09 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-31 11:40:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-31 11:40:36 [DEBUG   ] Got command RPT from MCS: ref #331405
2018-10-31 11:40:36 [DEBUG   ] summary = ERROR
2018-10-31 11:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331405  13 58422 42036637 A  ERRORERROR'
2018-10-31 11:40:36 [DEBUG   ] Got command RPT from MCS: ref #331406
2018-10-31 11:40:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331406  77 58422 42036841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #331407
2018-10-31 11:40:37 [DEBUG   ] summary = ERROR
2018-10-31 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331407  13 58422 42037045 A  ERRORERROR'
2018-10-31 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #331408
2018-10-31 11:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331408  77 58422 42037238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #331409
2018-10-31 11:40:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331409  12 58422 42037441 A  ERRORB'
2018-10-31 11:40:40 [DEBUG   ] Got command RPT from MCS: ref #331410
2018-10-31 11:40:40 [DEBUG   ] summary = ERROR
2018-10-31 11:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331410  13 58422 42040142 A  ERRORERROR'
2018-10-31 11:40:40 [DEBUG   ] Got command RPT from MCS: ref #331411
2018-10-31 11:40:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331411  77 58422 42040142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:40:49 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-31 11:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:41:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:41:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:41:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:41:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:41:08 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-31 11:41:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:41:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:41:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:42:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:42:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:42:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:42:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:42:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:42:08 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-10-31 11:42:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:42:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:42:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:43:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:43:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:43:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:43:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:43:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:43:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:43:08 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-31 11:43:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:43:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:43:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 11:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:44:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:44:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:44:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:44:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:44:08 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-31 11:44:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:44:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-31 11:44:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:45:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:45:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:45:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:45:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:45:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:45:08 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-10-31 11:45:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:45:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:45:36 [DEBUG   ] Got command RPT from MCS: ref #331433
2018-10-31 11:45:36 [DEBUG   ] summary = ERROR
2018-10-31 11:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331433  13 58422 42336721 A  ERRORERROR'
2018-10-31 11:45:36 [DEBUG   ] Got command RPT from MCS: ref #331434
2018-10-31 11:45:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331434  77 58422 42336927 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #331435
2018-10-31 11:45:37 [DEBUG   ] summary = ERROR
2018-10-31 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331435  13 58422 42337129 A  ERRORERROR'
2018-10-31 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #331437
2018-10-31 11:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331437  77 58422 42337321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #331438
2018-10-31 11:45:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331438  12 58422 42337525 A  ERRORB'
2018-10-31 11:45:40 [DEBUG   ] Got command RPT from MCS: ref #331443
2018-10-31 11:45:40 [DEBUG   ] summary = ERROR
2018-10-31 11:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331443  13 58422 42340335 A  ERRORERROR'
2018-10-31 11:45:40 [DEBUG   ] Got command RPT from MCS: ref #331444
2018-10-31 11:45:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331444  77 58422 42340335 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:45:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:46:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:46:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:46:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:46:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:46:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:46:08 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-31 11:46:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:46:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:46:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:47:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:47:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:47:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:47:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:47:08 [WARNING ] (13, 1, 'bot')
2018-10-31 11:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:47:08 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-10-31 11:47:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:47:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:47:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:48:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:48:09 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-10-31 11:48:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:48:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:48:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:48:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:48:09 [DEBUG   ] Finished updating board flags in 2.183 seconds
2018-10-31 11:48:29 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-10-31 11:48:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 11:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:49:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:49:09 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-10-31 11:49:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:49:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:49:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:49:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:49:09 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-10-31 11:49:29 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-31 11:49:49 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-31 11:50:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 11:50:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:50:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:50:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:50:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:50:09 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-31 11:50:10 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-31 11:50:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:50:36 [DEBUG   ] Got command RPT from MCS: ref #331468
2018-10-31 11:50:36 [DEBUG   ] summary = ERROR
2018-10-31 11:50:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331468  13 58422 42636809 A  ERRORERROR'
2018-10-31 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #331469
2018-10-31 11:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331469  77 58422 42637013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #331470
2018-10-31 11:50:37 [DEBUG   ] summary = ERROR
2018-10-31 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331470  13 58422 42637205 A  ERRORERROR'
2018-10-31 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #331471
2018-10-31 11:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331471  77 58422 42637409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #331472
2018-10-31 11:50:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331472  12 58422 42637613 A  ERRORB'
2018-10-31 11:50:40 [DEBUG   ] Got command RPT from MCS: ref #331473
2018-10-31 11:50:40 [DEBUG   ] summary = ERROR
2018-10-31 11:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331473  13 58422 42640145 A  ERRORERROR'
2018-10-31 11:50:40 [DEBUG   ] Got command RPT from MCS: ref #331474
2018-10-31 11:50:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331474  77 58422 42640146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:50:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:51:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:51:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:51:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:51:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:51:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:51:09 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-31 11:51:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 11:51:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 11:51:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 11:52:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:52:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:52:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:52:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:52:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:52:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:52:09 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-31 11:52:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 11:52:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:52:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:53:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:53:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:53:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:53:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:53:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:53:10 [DEBUG   ] Finished updating board flags in 2.310 seconds
2018-10-31 11:53:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:53:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 11:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:54:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:54:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:54:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:54:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:54:09 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-10-31 11:54:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 11:54:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:54:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-31 11:55:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:55:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:55:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:55:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:55:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:55:09 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-10-31 11:55:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:55:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:55:36 [DEBUG   ] Got command RPT from MCS: ref #331500
2018-10-31 11:55:36 [DEBUG   ] summary = ERROR
2018-10-31 11:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331500  13 58422 42936893 A  ERRORERROR'
2018-10-31 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #331501
2018-10-31 11:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331501  77 58422 42937097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #331502
2018-10-31 11:55:37 [DEBUG   ] summary = ERROR
2018-10-31 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331502  13 58422 42937289 A  ERRORERROR'
2018-10-31 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #331504
2018-10-31 11:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331504  77 58422 42937493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #331505
2018-10-31 11:55:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331505  12 58422 42937697 A  ERRORB'
2018-10-31 11:55:40 [DEBUG   ] Got command RPT from MCS: ref #331510
2018-10-31 11:55:40 [DEBUG   ] summary = ERROR
2018-10-31 11:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331510  13 58422 42940145 A  ERRORERROR'
2018-10-31 11:55:40 [DEBUG   ] Got command RPT from MCS: ref #331511
2018-10-31 11:55:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 11:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331511  77 58422 42940146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 11:55:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 11:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:56:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:56:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:56:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:56:09 [WARNING ] (13, 1, 'bot')
2018-10-31 11:56:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:56:09 [DEBUG   ] Finished updating board flags in 1.516 seconds
2018-10-31 11:56:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:56:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:56:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 11:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:57:10 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-10-31 11:57:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:57:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:57:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:57:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:57:10 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-10-31 11:57:30 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-10-31 11:57:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 11:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:58:10 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-10-31 11:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 11:58:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:58:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:58:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:58:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:58:10 [DEBUG   ] Finished updating board flags in 2.125 seconds
2018-10-31 11:58:30 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-31 11:58:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 11:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 11:59:10 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-10-31 11:59:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:59:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:59:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:59:10 [WARNING ] (13, 1, 'bot')
2018-10-31 11:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 11:59:10 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-10-31 11:59:31 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-10-31 11:59:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:00:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:00:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:00:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:00:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:00:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:00:10 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-31 12:00:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:00:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:00:36 [DEBUG   ] Got command RPT from MCS: ref #331531
2018-10-31 12:00:36 [DEBUG   ] summary = ERROR
2018-10-31 12:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331531  13 58422 43236973 A  ERRORERROR'
2018-10-31 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #331532
2018-10-31 12:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331532  77 58422 43237177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #331533
2018-10-31 12:00:37 [DEBUG   ] summary = ERROR
2018-10-31 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331533  13 58422 43237381 A  ERRORERROR'
2018-10-31 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #331534
2018-10-31 12:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331534  77 58422 43237585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #331535
2018-10-31 12:00:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331535  12 58422 43237777 A  ERRORB'
2018-10-31 12:00:40 [DEBUG   ] Got command RPT from MCS: ref #331536
2018-10-31 12:00:40 [DEBUG   ] summary = ERROR
2018-10-31 12:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331536  13 58422 43240153 A  ERRORERROR'
2018-10-31 12:00:40 [DEBUG   ] Got command RPT from MCS: ref #331537
2018-10-31 12:00:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331537  77 58422 43240154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:00:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:01:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:01:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:01:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:01:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:01:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:01:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:01:10 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-10-31 12:01:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:01:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:01:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:02:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:02:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 12:02:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:02:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:02:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:02:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:02:11 [DEBUG   ] Finished updating board flags in 2.916 seconds
2018-10-31 12:02:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:02:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:03:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 12:03:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:03:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:03:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:03:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:03:10 [DEBUG   ] Finished updating board flags in 1.648 seconds
2018-10-31 12:03:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:03:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:03:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:04:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:04:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:04:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:04:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:04:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:04:10 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-10-31 12:04:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:04:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:04:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:05:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-31 12:05:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:05:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:05:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:05:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:05:11 [DEBUG   ] Finished updating board flags in 2.719 seconds
2018-10-31 12:05:31 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-31 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #331563
2018-10-31 12:05:37 [DEBUG   ] summary = ERROR
2018-10-31 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331563  13 58422 43537061 A  ERRORERROR'
2018-10-31 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #331564
2018-10-31 12:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331564  77 58422 43537265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #331565
2018-10-31 12:05:37 [DEBUG   ] summary = ERROR
2018-10-31 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331565  13 58422 43537457 A  ERRORERROR'
2018-10-31 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #331567
2018-10-31 12:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331567  77 58422 43537661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #331568
2018-10-31 12:05:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331568  12 58422 43537865 A  ERRORB'
2018-10-31 12:05:40 [DEBUG   ] Got command RPT from MCS: ref #331573
2018-10-31 12:05:40 [DEBUG   ] summary = ERROR
2018-10-31 12:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331573  13 58422 43540332 A  ERRORERROR'
2018-10-31 12:05:40 [DEBUG   ] Got command RPT from MCS: ref #331574
2018-10-31 12:05:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331574  77 58422 43540333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:05:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 12:06:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-31 12:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:06:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:06:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:06:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:06:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:06:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:06:10 [DEBUG   ] Finished updating board flags in 1.516 seconds
2018-10-31 12:06:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 12:06:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 12:06:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-31 12:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:07:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:07:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:07:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:07:10 [WARNING ] (13, 1, 'bot')
2018-10-31 12:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:07:10 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-10-31 12:07:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 12:07:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 12:07:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 12:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:08:11 [DEBUG   ] Finished updating ant stats in 1.054 seconds
2018-10-31 12:08:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:08:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:08:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:08:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:08:11 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-10-31 12:08:31 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-10-31 12:08:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-31 12:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:09:11 [DEBUG   ] Finished updating ant stats in 0.853 seconds
2018-10-31 12:09:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:09:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:09:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:09:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:09:11 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-10-31 12:09:31 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2018-10-31 12:09:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 12:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:10:11 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-10-31 12:10:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:10:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:10:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:10:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:10:11 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-10-31 12:10:31 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-10-31 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #331598
2018-10-31 12:10:37 [DEBUG   ] summary = ERROR
2018-10-31 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331598  13 58422 43837149 A  ERRORERROR'
2018-10-31 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #331599
2018-10-31 12:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331599  77 58422 43837341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #331600
2018-10-31 12:10:37 [DEBUG   ] summary = ERROR
2018-10-31 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331600  13 58422 43837545 A  ERRORERROR'
2018-10-31 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #331601
2018-10-31 12:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331601  77 58422 43837749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #331602
2018-10-31 12:10:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331602  12 58422 43837953 A  ERRORB'
2018-10-31 12:10:40 [DEBUG   ] Got command RPT from MCS: ref #331603
2018-10-31 12:10:40 [DEBUG   ] summary = ERROR
2018-10-31 12:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331603  13 58422 43840149 A  ERRORERROR'
2018-10-31 12:10:40 [DEBUG   ] Got command RPT from MCS: ref #331604
2018-10-31 12:10:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331604  77 58422 43840150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:10:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-31 12:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:11:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:11:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:11:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:11:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:11:11 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-31 12:11:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-31 12:11:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:11:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:12:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:12:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:12:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:12:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:12:11 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-10-31 12:12:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-31 12:12:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 12:12:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-31 12:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:13:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 12:13:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:13:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:13:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:13:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:13:12 [DEBUG   ] Finished updating board flags in 2.726 seconds
2018-10-31 12:13:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-31 12:13:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-31 12:14:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:14:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:14:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:14:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:14:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:14:11 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-10-31 12:14:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-31 12:14:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 12:14:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 12:15:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:15:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:15:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:15:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:15:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:15:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:15:11 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-31 12:15:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 12:15:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-31 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #331626
2018-10-31 12:15:37 [DEBUG   ] summary = ERROR
2018-10-31 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331626  13 58422 44137229 A  ERRORERROR'
2018-10-31 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #331627
2018-10-31 12:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331627  77 58422 44137433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #331628
2018-10-31 12:15:37 [DEBUG   ] summary = ERROR
2018-10-31 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331628  13 58422 44137637 A  ERRORERROR'
2018-10-31 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #331630
2018-10-31 12:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331630  77 58422 44137829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:15:38 [DEBUG   ] Got command RPT from MCS: ref #331632
2018-10-31 12:15:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 12:15:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331632  12 58422 44138033 A  ERRORB'
2018-10-31 12:15:40 [DEBUG   ] Got command RPT from MCS: ref #331636
2018-10-31 12:15:40 [DEBUG   ] summary = ERROR
2018-10-31 12:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331636  13 58422 44140157 A  ERRORERROR'
2018-10-31 12:15:40 [DEBUG   ] Got command RPT from MCS: ref #331637
2018-10-31 12:15:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331637  77 58422 44140158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:15:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-31 12:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:16:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-31 12:16:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:16:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:16:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:16:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:16:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:16:11 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-31 12:16:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-31 12:16:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 12:16:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 12:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:17:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:17:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:17:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:17:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:17:11 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-10-31 12:17:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 12:17:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 12:17:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 12:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:18:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:18:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:18:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:18:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:18:11 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-10-31 12:18:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 12:18:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 12:18:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 12:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:19:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:19:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:19:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:19:11 [WARNING ] (13, 1, 'bot')
2018-10-31 12:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:19:11 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-31 12:19:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-31 12:19:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-31 12:19:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-31 12:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:20:12 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-10-31 12:20:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:20:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:20:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:20:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:20:12 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-10-31 12:20:32 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-31 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #331661
2018-10-31 12:20:37 [DEBUG   ] summary = ERROR
2018-10-31 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331661  13 58422 44437313 A  ERRORERROR'
2018-10-31 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #331662
2018-10-31 12:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331662  77 58422 44437517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #331663
2018-10-31 12:20:37 [DEBUG   ] summary = ERROR
2018-10-31 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331663  13 58422 44437721 A  ERRORERROR'
2018-10-31 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #331664
2018-10-31 12:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331664  77 58422 44437913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:20:38 [DEBUG   ] Got command RPT from MCS: ref #331665
2018-10-31 12:20:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-31 12:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331665  12 58422 44438118 A  ERRORB'
2018-10-31 12:20:40 [DEBUG   ] Got command RPT from MCS: ref #331666
2018-10-31 12:20:40 [DEBUG   ] summary = ERROR
2018-10-31 12:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331666  13 58422 44440157 A  ERRORERROR'
2018-10-31 12:20:40 [DEBUG   ] Got command RPT from MCS: ref #331667
2018-10-31 12:20:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-31 12:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   331667  77 58422 44440158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-31 12:20:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-31 12:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:21:12 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-10-31 12:21:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:21:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:21:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:21:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:21:12 [DEBUG   ] Finished updating board flags in 1.968 seconds
2018-10-31 12:21:33 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2018-10-31 12:21:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:22:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:22:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:22:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:22:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:22:12 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-31 12:22:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:22:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-31 12:22:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:23:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:23:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:23:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:23:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:23:12 [DEBUG   ] Finished updating board flags in 1.692 seconds
2018-10-31 12:23:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:23:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:23:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-31 12:24:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:24:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:24:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:24:12 [WARNING ] (13, 1, 'bot')
2018-10-31 12:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-31 12:24:12 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-31 12:24:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-31 12:24:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-31 12:24:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
